00000001:02000400:2.0F:1789778033.616215:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789778052.200990:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789778054.214191:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 586 MB/s 00000001:01000000:1.0F:1789778054.467463:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 641 MB/s 00000001:01000000:2.0:1789778054.717172:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2875 MB/s 00000020:02000000:0.0F:1789778055.748678:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_110_g5f5d390 00000400:02000000:3.0:1789778056.870588:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.145@tcp [8/256/0/180] 00008000:02000000:1.0:1789778060.460192:0:3443:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789778109.323608:0:5254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789778118.235812:0:5826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789778118.235816:0:5826:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789778118.235901:0:5826:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f3fac0e0 00000080:02000400:2.0:1789778118.235909:0:5826:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789778118.239688:0:5826:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789778118.239703:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789778118.239740:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fc946a32) 00000020:00000080:2.0:1789778118.239763:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789778118.258640:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789778118.258934:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789778118.282110:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789778118.282134:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789778118.282145:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789778118.282446:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789778118.283016:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789778118.284206:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789778118.284215:0:5826:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789778118.284226:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157440a0f 00000020:01000004:1.0:1789778118.284234:0:5826:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789778118.284238:0:5826:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789778118.284243:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f3fac0e0 from MGS 00000020:01000004:1.0:1789778118.284247:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789778118.284267:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f24d7384) 00000020:00000080:1.0:1789778118.284278:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789778118.284381:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f3fac0e0 from MGS, refs=2 00080000:01000000:1.0:1789778118.284387:0:5826:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789778118.284392:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157440a1d 00000100:00100000:1.0:1789778118.284553:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789778118.284698:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789778118.284704:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789778118.285340:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789778118.285345:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789778118.285994:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789778118.286225:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789778118.286230:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789778118.286660:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789778118.286666:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789778118.286990:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789778118.286997:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789778118.288000:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778118.288004:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778118.288005:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778118.288481:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778118.288483:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778118.288492:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778118.289048:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789778118.295192:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789778118.538316:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2979 MB/s 00000001:01000000:1.0:1789778118.793019:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2775 MB/s 00000001:01000000:2.0:1789778119.049743:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 521 MB/s 00000001:01000000:3.0:1789778119.299241:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 915 MB/s 00080000:10000000:2.0:1789778119.304619:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789778119.313442:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789778119.313460:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789778119.313463:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789778119.314245:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789778119.314304:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789778119.314345:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789778119.314490:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789778119.314512:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789778119.314986:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789778119.317086:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789778119.317096:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789778119.318456:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789778119.318465:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789778119.319275:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789778119.319283:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789778119.320835:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789778119.320857:0:5826:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.145@tcp' 00000020:01000004:2.0:1789778119.320859:0:5826:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789778119.320908:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.145@tcp (typ=mgc) 00000020:00000080:2.0:1789778119.320927:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.145@tcp (0000000057aa4dd0) 00000020:00000080:2.0:1789778119.320958:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789778119.321051:0:5826:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000079808514@MGC192.168.201.145@tcp: add connection 192.168.201.145@tcp at head 00010000:00010000:2.0:1789778119.321345:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.145@tcp-0 is initialized 00000040:01000000:2.0:1789778119.321358:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789778119.323804:0:5842:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789778119.323848:0:5843:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789778119.323886:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.145@tcp (uuid a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5) 00000020:00000080:3.0:1789778119.323905:0:5826:0:(genops.c:1385:class_connect()) connect: client a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5, cookie 0x5a1e1c1157440a2b 00000100:00080000:3.0:1789778119.323918:0:5826:0:(import.c:510:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789778119.323921:0:5826:0:(import.c:624:import_select_connection()) MGC192.168.201.145@tcp: import 0000000079808514 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1789778119.323976:0:5826:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ce191bfb x1876718314848384/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789778119.324098:0:5826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5->MGS 00000020:01000004:0.0:1789778119.324131:0:5826:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789778119.324136:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:3.0:1789778119.324167:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3309:1876718314848384:0@lo:250: 00000020:00000080:0.0:1789778119.324171:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000052955ea4) 00000020:00000080:0.0:1789778119.324186:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789778119.324272:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778119.324361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314848384 00000100:00100000:3.0:1789778119.324367:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314848384 00000100:00100000:3.0:1789778119.324412:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778119.324419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036124806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1876718314848384:12345-0@lo:250: 00010000:00080000:3.0:1789778119.324443:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1789778119.324472:0:5839:0:(genops.c:1385:class_connect()) connect: client a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5, cookie 0x5a1e1c1157440a39 00000100:00080000:3.0:1789778119.324614:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000601ee6b9 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789778119.324674:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036124806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:3309:x1876718314848384:12345-0@lo:250: Request processed in 253us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778119.324682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778119.324735:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789778119.324743:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1789778119.324749:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789778119.324753:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789778119.324755:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000079808514 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789778119.324757:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789778119.324765:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789778119.324769:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3309:1876718314848384:0@lo:250: 00000100:00100000:0.0:1789778119.332859:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778119.333297:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789778119.333304:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789778119.334670:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789778119.334679:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789778119.336976:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789778119.336990:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789778119.337951:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778119.338183:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789778119.338188:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789778119.338738:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789778119.338744:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1789778119.353101:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778119.369598:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778119.369821:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789778119.369827:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789778119.372897:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789778119.372916:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789778119.373748:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778119.373958:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789778119.373963:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789778119.374965:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789778119.374977:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789778119.377802:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778119.377989:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789778119.377996:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789778119.378541:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789778119.378546:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789778119.381285:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778119.381610:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789778119.381616:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789778119.382588:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789778119.382597:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789778119.408346:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778119.408576:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789778119.408582:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789778119.410476:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789778119.410489:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789778119.412185:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789778119.412271:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789778119.412909:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789778119.412927:0:5826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789778119.412932:0:5826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789778119.413052:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789778119.413208:0:5826:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789778119.413213:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789778119.413215:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778119.413216:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778119.413218:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778119.413219:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778119.413220:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778119.413221:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778119.413222:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778119.413224:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789778119.413225:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789778119.413227:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778119.413228:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789778119.413231:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789778119.413234:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789778119.413235:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778119.413236:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778119.413237:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778119.413238:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778119.413244:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778119.413245:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778119.413246:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778119.413246:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789778119.413247:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789778119.413248:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778119.413249:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789778119.413284:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789778119.413302:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1cec062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848512:0@lo:253: 00000100:00100000:2.0:1789778119.413378:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778119.413426:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314848512 00000100:00100000:1.0:1789778119.413434:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314848512 00000100:00100000:2.0:1789778119.413502:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8993eb8 going to sleep for 11 seconds 00000100:00100000:1.0:1789778119.413822:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789778119.413831:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007761e9dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:5826:x1876718314848512:12345-0@lo:253: 20000000:01000000:1.0:1789778119.413879:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789778119.413882:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789778119.414661:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789778119.414711:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789778119.415122:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789778119.415995:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789778119.417571:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789778119.417579:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789778119.417586:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789778119.417589:0:5841:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789778119.417610:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789778119.417873:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778119.418254:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789778119.418268:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789778119.418319:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789778119.418371:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789778119.418410:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789778119.418500:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789778119.418509:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789778119.418554:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789778119.418563:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789778119.418607:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789778119.418615:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789778119.418646:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789778119.418696:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789778119.418723:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789778119.418728:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789778119.418741:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778119.418953:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789778119.418963:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789778119.418995:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789778119.419023:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789778119.419101:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789778119.419122:0:5841:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789778119.419197:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789778119.419206:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789778119.419254:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789778119.419292:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789778119.419327:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789778119.419337:0:5841:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789778119.419416:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789778119.419424:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789778119.419449:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789778119.419477:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789778119.419641:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789778119.419692:0:5841:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789778119.419700:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789778119.420368:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789778119.420655:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789778119.420681:0:5841:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.145@tcp for mdt 20000000:01000000:1.0:1789778119.420683:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:1.0:1789778119.420718:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789778119.420726:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789778119.420777:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789778119.420785:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:1.0:1789778119.420819:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789778119.420825:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789778119.420842:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789778119.420859:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789778119.420896:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789778119.420899:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789778119.420903:0:5841:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789778119.420909:0:5841:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789778119.421354:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789778119.421442:0:5841:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789778119.426049:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789778119.426188:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1789778119.426274:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1789778119.426295:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789778119.426298:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789778119.426302:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789778119.426314:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789778119.426316:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789778119.426347:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789778119.426349:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789778119.427318:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789778119.427637:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789778119.427684:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789778119.427717:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789778119.427730:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789778119.427732:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789778119.428249:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1789778119.428468:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1789778119.428508:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1789778119.428566:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1789778119.428580:0:5841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789778119.428583:0:5841:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789778119.428589:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789778119.428611:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428629:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428640:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428647:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428671:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428676:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428681:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066ad9560 already unused, calling callback (000000005762a2b0) 00010000:00010000:2.0:1789778119.428685:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428692:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428705:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428712:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.428718:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000066ad9560/0x5a1e1c1157440a40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789778119.428734:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789778119.596496:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007761e9dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:5826:x1876718314848512:12345-0@lo:253: Request processed in 182658us (183108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778119.596512:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778119.596618:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1cec062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848512:0@lo:253: 10000000:01000000:2.0:1789778119.596634:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789778119.596637:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789778119.596639:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778119.596640:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778119.596642:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789778119.596643:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778119.596658:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778119.596660:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778119.596661:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778119.596663:0:5826:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789778119.596664:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778119.596666:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789778119.596682:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f3fac0e0 from lustre-MDT0000 10000000:01000000:2.0:1789778119.596706:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789778119.596709:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789778119.596713:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b3e85d019b8 10000000:01000000:2.0:1789778119.596718:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778119.596725:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b3e85d019b8 from 1 10000000:01000000:2.0:1789778119.596728:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789778119.596763:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.596774:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.596783:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778119.596801:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1cec062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848640:0@lo:101: 00000100:00100000:2.0:1789778119.596848:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778119.596948:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5c4a37e going to sleep for 11 seconds 00000100:00100000:3.0:1789778119.597058:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314848640 00000100:00100000:3.0:1789778119.597143:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314848640 00000100:00100000:2.0:1789778119.597368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789778119.597376:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3dee8ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:5826:x1876718314848640:12345-0@lo:101: 00010000:00010000:2.0:1789778119.597389:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778119.597402:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440a47 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.597423:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.597440:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778119.597448:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e8abf0d, rc 0) 00000100:00100000:2.0:1789778119.597532:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3dee8ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:5826:x1876718314848640:12345-0@lo:101: Request processed in 156us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778119.597539:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789778119.597590:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1cec062 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848640:0@lo:101: 00010000:00010000:0.0:1789778119.597604:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.597612:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778119.597676:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848768:0@lo:501: 00000100:00100000:0.0:1789778119.597731:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778119.597824:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018ab75b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789778119.597908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314848768 00000100:00100000:3.0:1789778119.597913:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314848768 00000100:00100000:3.0:1789778119.597948:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789778119.597954:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7b35b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:5826:x1876718314848768:12345-0@lo:501: 00000100:00100000:3.0:1789778119.598201:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7b35b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:5826:x1876718314848768:12345-0@lo:501: Request processed in 247us (469us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789778119.598208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789778119.598340:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848768:0@lo:501: 10000000:01000000:0.0:1789778119.598367:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789778119.598377:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.598384:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778119.598392:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3eabbad800 10000000:01000000:0.0:1789778119.598395:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789778119.598399:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b3eabbad800 10000000:01000000:0.0:1789778119.598402:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789778119.598404:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b3eabbad800 from 1 10000000:01000000:0.0:1789778119.598406:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789778119.598425:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000860b270f/0x5a1e1c1157440a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.598441:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000860b270f/0x5a1e1c1157440a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.598448:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000860b270f/0x5a1e1c1157440a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778119.598459:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848896:0@lo:101: 00000100:00100000:0.0:1789778119.598489:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778119.598506:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018ab75b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789778119.598594:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314848896 00000100:00100000:3.0:1789778119.598604:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314848896 00000100:00100000:3.0:1789778119.598624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789778119.598630:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae9192d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:5826:x1876718314848896:12345-0@lo:101: 00010000:00010000:3.0:1789778119.598639:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778119.598651:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a744bc9/0x5a1e1c1157440a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440a55 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778119.598665:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a744bc9/0x5a1e1c1157440a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440a55 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778119.598672:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a744bc9/0x5a1e1c1157440a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440a55 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778119.598678:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a744bc9, rc 0) 00000100:00100000:3.0:1789778119.598716:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae9192d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:5826:x1876718314848896:12345-0@lo:101: Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778119.598722:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789778119.598805:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314848896:0@lo:101: 00010000:00010000:0.0:1789778119.598815:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000860b270f/0x5a1e1c1157440a55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.598823:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000860b270f/0x5a1e1c1157440a55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778119.598833:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789778119.598846:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000860b270f/0x5a1e1c1157440a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.598852:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000860b270f/0x5a1e1c1157440a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778119.598857:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789778119.598861:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789778119.598866:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b3eabbad800 10000000:01000000:0.0:1789778119.598869:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789778119.598872:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789778119.598880:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789778119.598894:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.598900:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.598906:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778119.598917:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849024:0@lo:101: 00000100:00100000:0.0:1789778119.598958:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778119.598969:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018ab75b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789778119.599027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849024 00000100:00100000:3.0:1789778119.599032:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849024 00000100:00100000:3.0:1789778119.599050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789778119.599055:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d970336a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:5826:x1876718314849024:12345-0@lo:101: 00010000:00010000:3.0:1789778119.599062:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778119.599085:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440a63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778119.599098:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778119.599106:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778119.599122:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000888fdf6d, rc 0) 00000100:00100000:3.0:1789778119.599156:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d970336a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+8:5826:x1876718314849024:12345-0@lo:101: Request processed in 101us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778119.599163:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789778119.599245:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849024:0@lo:101: 00010000:00010000:0.0:1789778119.599254:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778119.599262:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778119.599297:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849152:0@lo:501: 00000100:00100000:0.0:1789778119.599323:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778119.599347:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018ab75b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789778119.599396:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849152 00000100:00100000:3.0:1789778119.599400:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849152 00000100:00100000:3.0:1789778119.599416:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789778119.599421:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9766b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+8:5826:x1876718314849152:12345-0@lo:501: 00000100:00100000:3.0:1789778119.599615:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9766b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5826:x1876718314849152:12345-0@lo:501: Request processed in 193us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778119.599623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789778119.599754:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849152:0@lo:501: 00000100:00100000:0.0:1789778119.599780:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849280:0@lo:503: 00000100:00100000:0.0:1789778119.599818:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778119.599841:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018ab75b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789778119.599893:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849280 00000100:00100000:3.0:1789778119.599897:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849280 00000100:00100000:3.0:1789778119.599913:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789778119.599918:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019213562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5826:x1876718314849280:12345-0@lo:503: 00000100:00100000:3.0:1789778119.600105:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019213562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5826:x1876718314849280:12345-0@lo:503: Request processed in 186us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778119.600112:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789778119.600194:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849280:0@lo:503: 00000100:00100000:0.0:1789778119.600727:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5868:1876718314849408:0@lo:502: 00000100:00100000:0.0:1789778119.600772:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778119.600802:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b95c8d39 going to sleep for 11 seconds 00000100:00100000:3.0:1789778119.600853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849408 00000100:00100000:3.0:1789778119.600858:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849408 00000100:00100000:3.0:1789778119.600889:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778119.600896:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db4d40f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5868:x1876718314849408:12345-0@lo:502: 00000100:00100000:3.0:1789778119.601057:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db4d40f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5868:x1876718314849408:12345-0@lo:502: Request processed in 162us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778119.601079:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789778119.601187:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5868:1876718314849408:0@lo:502: 00000020:01000000:0.0:1789778119.601207:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778119.601217:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778119.601219:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789778119.601224:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789778119.601228:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778119.601303:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f920053b) 00000020:00000080:0.0:1789778119.601320:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789778119.601325:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789778119.601406:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789778119.601413:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157440a78 00000020:00000080:0.0:1789778119.601645:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789778119.601651:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778119.601654:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778119.601655:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789778119.601658:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778119.601661:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778119.601662:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789778119.601665:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778119.601672:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d40faff0) 00000020:00000080:0.0:1789778119.601682:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789778119.601685:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789778119.601687:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789778119.601690:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789778119.601695:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789778119.601736:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f3fac0e0 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789778119.601747:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000055cd2071) 00000020:00000080:0.0:1789778119.601755:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789778119.601814:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789778119.601821:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157440a8d 00000020:00000080:0.0:1789778119.601955:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789778119.601962:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789778119.601967:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5a1e1c1157440a94 00080000:01000000:0.0:1789778119.601972:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789778119.601975:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157440a9b 00080000:10000000:0.0:1789778119.602557:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789778119.602770:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789778119.606891:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789778119.682969:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789778119.683939:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789778119.688164:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789778119.688409:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789778119.722577:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c66fad6e) 00000020:00000080:3.0:1789778119.722605:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789778119.722678:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789778119.722684:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157440aa9 00000020:00000080:1.0:1789778119.729557:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789778119.731894:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778119.788701:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778119.822663:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778119.857167:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778119.916603:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789778120.015559:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789778120.046913:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5a1e1c1157440ab0 00000020:00000080:0.0:1789778120.047443:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789778120.047464:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778120.047471:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778120.047473:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789778120.047477:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778120.047485:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778120.047486:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789778120.047490:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789778120.047525:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789778120.047536:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778120.047538:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778120.047540:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789778120.047542:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778120.047544:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778120.047545:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789778120.047548:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789778120.047550:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789778120.047588:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5868:1876718314849536:0@lo:502: 00000100:00100000:0.0:1789778120.047673:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778120.047721:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000002484ff75 going to sleep for 11 seconds 00000100:00100000:2.0:1789778120.048015:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849536 00000100:00100000:2.0:1789778120.048023:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849536 00000100:00100000:2.0:1789778120.048090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789778120.048098:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cbcf371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5868:x1876718314849536:12345-0@lo:502: 00000100:00100000:2.0:1789778120.048744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cbcf371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5868:x1876718314849536:12345-0@lo:502: Request processed in 646us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778120.048754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789778120.048878:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017a47f0e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5868:1876718314849536:0@lo:502: 00000020:01000000:1.0:1789778120.048909:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778120.048915:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778120.048917:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789778120.048920:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789778120.049320:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789778120.049338:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789778120.049388:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.049399:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778120.049415:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3eabbad800 from 1 10000000:01000000:2.0:1789778120.049418:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789778120.049444:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.049450:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.049467:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778120.049481:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005590d281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849664:0@lo:101: 00000100:00100000:2.0:1789778120.049521:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778120.049550:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d0b3ce0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.049646:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849664 00000100:00100000:1.0:1789778120.049652:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849664 00000100:00100000:1.0:1789778120.049683:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789778120.049689:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e6d7777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:5826:x1876718314849664:12345-0@lo:101: 00010000:00010000:1.0:1789778120.049698:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778120.049710:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440ab7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.049739:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.049747:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.049755:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5a09b44, rc 0) 00000100:00100000:1.0:1789778120.049791:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e6d7777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:5826:x1876718314849664:12345-0@lo:101: Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778120.049796:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789778120.049875:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005590d281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849664:0@lo:101: 00010000:00010000:0.0:1789778120.049887:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.049899:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778120.050582:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f7bb2d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849792:0@lo:256: 00000100:00100000:0.0:1789778120.050628:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778120.050652:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc250323 going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.050779:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849792 00000100:00100000:1.0:1789778120.050784:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849792 00000100:00100000:1.0:1789778120.050808:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789778120.050814:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9576118 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:5826:x1876718314849792:12345-0@lo:256: 20000000:01000000:1.0:1789778120.050827:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789778120.050832:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789778120.050884:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9576118 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:5826:x1876718314849792:12345-0@lo:256: Request processed in 71us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778120.050891:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789778120.050967:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f7bb2d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849792:0@lo:256: 10000000:01000000:0.0:1789778120.051651:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789778120.051879:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.051890:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778120.051898:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3eabbad800 from 1 10000000:01000000:0.0:1789778120.051901:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778120.051934:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.051941:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.051949:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778120.051961:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f7bb2d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849920:0@lo:101: 00000100:00100000:0.0:1789778120.051998:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778120.052037:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc250323 going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.052092:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314849920 00000100:00100000:1.0:1789778120.052097:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314849920 00000100:00100000:1.0:1789778120.052128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789778120.052134:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d8b57cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:5826:x1876718314849920:12345-0@lo:101: 00010000:00010000:1.0:1789778120.052143:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778120.052153:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440ac5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.052168:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.052182:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.052189:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb4363c0, rc 0) 00000100:00100000:1.0:1789778120.052397:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d8b57cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5826:x1876718314849920:12345-0@lo:101: Request processed in 263us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778120.052404:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789778120.052480:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f7bb2d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314849920:0@lo:101: 00010000:00010000:2.0:1789778120.052491:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.052499:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778120.052545:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850048:0@lo:501: 00000100:00100000:2.0:1789778120.052570:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778120.052596:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069b33eea going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.052681:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850048 00000100:00100000:1.0:1789778120.052685:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850048 00000100:00100000:1.0:1789778120.052710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789778120.052715:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c75192fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5826:x1876718314850048:12345-0@lo:501: 00000100:00100000:1.0:1789778120.053426:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c75192fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5826:x1876718314850048:12345-0@lo:501: Request processed in 709us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778120.053433:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789778120.053667:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850048:0@lo:501: 00000100:00100000:2.0:1789778120.053701:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850176:0@lo:503: 00000100:00100000:2.0:1789778120.053756:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778120.053787:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069b33eea going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.053838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850176 00000100:00100000:1.0:1789778120.053843:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850176 00000100:00100000:1.0:1789778120.053915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789778120.053922:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000936e7179 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5826:x1876718314850176:12345-0@lo:503: 00000040:00080000:1.0:1789778120.053968:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789778120.054009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000936e7179 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5826:x1876718314850176:12345-0@lo:503: Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778120.054016:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789778120.054118:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850176:0@lo:503: 00000040:00080000:0.0:1789778120.055626:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789778120.055812:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789778120.055831:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789778120.055892:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.055904:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778120.055957:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789778120.055960:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3eabbad800 10000000:01000000:2.0:1789778120.055963:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3eabbad800 10000000:01000000:2.0:1789778120.055967:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778120.055974:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3eabbad800 from 1 10000000:01000000:2.0:1789778120.055977:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789778120.056009:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.056015:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.056025:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778120.056041:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850304:0@lo:101: 00000100:00100000:2.0:1789778120.056385:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778120.056429:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000389a2de going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.056560:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850304 00000100:00100000:1.0:1789778120.056567:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850304 00000100:00100000:1.0:1789778120.056612:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789778120.056620:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020ea745d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5826:x1876718314850304:12345-0@lo:101: 00010000:00010000:1.0:1789778120.056640:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778120.056652:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440ad3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.056673:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.056681:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778120.056689:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012e6681c, rc 0) 00000100:00100000:1.0:1789778120.056725:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020ea745d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5826:x1876718314850304:12345-0@lo:101: Request processed in 105us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778120.056732:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789778120.056843:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850304:0@lo:101: 00010000:00010000:2.0:1789778120.056855:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.056863:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778120.056909:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850432:0@lo:501: 00000100:00100000:2.0:1789778120.056951:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778120.056968:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000389a2de going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.057018:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850432 00000100:00100000:1.0:1789778120.057023:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850432 00000100:00100000:1.0:1789778120.057051:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789778120.057057:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ef30794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5826:x1876718314850432:12345-0@lo:501: 00000100:00100000:1.0:1789778120.057452:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ef30794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5826:x1876718314850432:12345-0@lo:501: Request processed in 395us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778120.057553:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c890bcef pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850432:0@lo:501: 00000100:00100000:3.0:1789778120.057583:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850560:0@lo:503: 00000100:00100000:3.0:1789778120.057625:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778120.057643:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8a44648 going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.057693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789778120.057712:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850560 00000100:00100000:1.0:1789778120.057716:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850560 00000100:00100000:1.0:1789778120.057730:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789778120.057735:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007481a081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5826:x1876718314850560:12345-0@lo:503: 00000100:00100000:1.0:1789778120.058096:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007481a081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5826:x1876718314850560:12345-0@lo:503: Request processed in 360us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778120.058103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789778120.058394:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314850560:0@lo:503: 00000100:00100000:0.0:1789778120.058805:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5873:1876718314850688:0@lo:502: 00000100:00100000:0.0:1789778120.058850:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778120.058909:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 00000000029529f2 going to sleep for 11 seconds 00000100:00100000:1.0:1789778120.058947:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850688 00000100:00100000:1.0:1789778120.058951:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850688 00000100:00100000:1.0:1789778120.059019:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789778120.059026:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a46be952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5873:x1876718314850688:12345-0@lo:502: 00000100:00100000:3.0:1789778120.059562:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a46be952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5873:x1876718314850688:12345-0@lo:502: Request processed in 536us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778120.059571:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789778120.059640:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5873:1876718314850688:0@lo:502: 00000020:01000004:0.0:1789778120.059695:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789778120.059717:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000065785ee) 00000020:00000080:0.0:1789778120.059737:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789778120.059803:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f3fac0e0 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789778120.059807:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f3fac0e0 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789778120.059809:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f3fac0e0 4 00010000:00080000:0.0:1789778120.059837:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006edc4fad@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1789778120.062084:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789778120.062447:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789778120.062553:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789778120.062566:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5a1e1c1157440ae8 00000100:00080000:0.0:1789778120.062574:0:5873:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789778120.062579:0:5873:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006edc4fad using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1789778120.062611:0:5873:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002a4b6fb8 x1876718314850816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789778120.062656:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314850816:0@lo:38: 00000100:00100000:0.0:1789778120.062725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778120.062789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850816 00000100:00100000:0.0:1789778120.062796:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850816 00000100:00100000:0.0:1789778120.062824:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789778120.062832:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b718a1e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876718314850816:12345-0@lo:38: 00000100:00100000:0.0:1789778120.062876:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b718a1e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876718314850816:12345-0@lo:38: Request processed in 43us (151us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789778120.062889:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789778120.062921:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789778120.062939:0:3309:0:(import.c:65:import_set_state_nolock()) 000000006edc4fad lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789778120.062954:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789778120.062957:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314850816:0@lo:38: 00000100:00080000:0.0:1789778120.062987:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789778120.066012:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7d6b02f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5873:1876718314850944:0@lo:502: 00000100:00100000:2.0:1789778120.066123:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778120.066161:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 000000005722caa8 going to sleep for 11 seconds 00000100:00100000:2.0:1789778120.066179:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314850944 00000100:00100000:2.0:1789778120.066185:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314850944 00000100:00100000:2.0:1789778120.067371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789778120.067383:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b97f2590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5873:x1876718314850944:12345-0@lo:502: 00000100:00100000:2.0:1789778120.068331:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b97f2590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5873:x1876718314850944:12345-0@lo:502: Request processed in 947us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778120.068341:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789778120.069905:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7d6b02f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5873:1876718314850944:0@lo:502: 00000040:00080000:1.0:1789778120.069975:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789778120.070618:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789778120.070644:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789778120.070660:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778120.070671:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789778120.070730:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789778120.070732:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778120.070733:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778120.070735:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778120.070736:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778120.070737:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778120.070739:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778120.070740:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778120.070741:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789778120.070743:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789778120.070745:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778120.070746:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789778120.070749:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789778120.070752:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789778120.070753:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778120.070754:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778120.070756:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778120.070757:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778120.070758:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778120.070759:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778120.070759:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778120.070760:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789778120.070761:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789778120.070762:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778120.070763:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789778120.070786:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789778120.070800:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000abe51af pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314851072:0@lo:253: 00000100:00100000:2.0:1789778120.070868:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778120.070900:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069b33eea going to sleep for 11 seconds 00000100:00100000:2.0:1789778120.070938:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851072 00000100:00100000:2.0:1789778120.070944:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851072 00000100:00100000:2.0:1789778120.070979:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789778120.070987:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc4eb43b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5826:x1876718314851072:12345-0@lo:253: 20000000:01000000:2.0:1789778120.071011:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789778120.071029:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789778120.106642:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789778120.106666:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789778120.106768:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789778120.106773:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789778120.106794:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.106815:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.106823:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.106862:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778120.106876:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 12 pid: 5841 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778120.106890:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876718314851200:0@lo:104: 00000100:00100000:0.0:1789778120.106969:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778120.107092:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851200 00000100:00100000:3.0:1789778120.107101:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851200 00000100:00100000:3.0:1789778120.107145:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778120.107154:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dfcd0bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5861:x1876718314851200:12345-0@lo:104: 00010000:00010000:3.0:1789778120.107166:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.107236:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789778120.107242:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dfcd0bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5861:x1876718314851200:12345-0@lo:104: Request processed in 90us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778120.107249:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789778120.107271:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778120.107275:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.107282:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d5085f69 already unused, calling callback (0000000096093876) 10000000:00010000:3.0:1789778120.107301:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.107308:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789778120.107315:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778120.107320:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789778120.107347:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.107354:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789778120.107371:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.107377:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000d5085f69/0x5a1e1c1157440ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440abe expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.107395:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778120.107397:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778120.107399:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778120.107449:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec9b614c going to sleep for 11 seconds 00000100:00100000:0.0:1789778120.107482:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876718314851200:0@lo:104: 00010000:00010000:0.0:1789778120.107500:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778120.110194:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314851328:0@lo:103: 00000100:00100000:3.0:1789778120.110273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778120.110357:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851328 00000100:00100000:3.0:1789778120.110365:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851328 00010000:00010000:3.0:1789778120.110392:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 13 pid: 5841 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778120.110424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778120.110446:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019c9f807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3311:x1876718314851328:12345-0@lo:103: 00010000:00010000:3.0:1789778120.110469:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778120.110474:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 13 pid: 5841 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110486:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 13 pid: 5841 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110502:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440ab7 expref: 13 pid: 5841 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110518:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110525:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789778120.110540:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003767843s 00010000:00010000:3.0:1789778120.110543:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110549:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110554:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110558:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110563:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000086b87b0a already unused, calling callback (000000005762a2b0) 00010000:00010000:3.0:1789778120.110571:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110577:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110591:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110602:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778120.110637:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019c9f807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3311:x1876718314851328:12345-0@lo:103: Request processed in 192us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778120.110643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778120.110681:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314851328:0@lo:103: 00010000:00010000:3.0:1789778120.110702:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110708:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778120.110713:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000086b87b0a/0x5a1e1c1157440aef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778120.115664:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc4eb43b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5826:x1876718314851072:12345-0@lo:253: Request processed in 44670us (44788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778120.115680:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789778120.117161:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000abe51af pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5826:1876718314851072:0@lo:253: 10000000:01000000:2.0:1789778120.117181:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789778120.117185:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789778120.117187:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778120.117189:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778120.117190:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778120.117191:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778120.117192:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778120.117193:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778120.117195:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778120.117196:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789778120.117197:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789778120.117199:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778120.117200:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789778120.117215:0:5826:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789778120.123383:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789778120.123826:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789778120.124048:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789778120.124317:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789778120.124608:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789778120.124800:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789778120.128617:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789778120.128829:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789778120.129047:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789778120.129448:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789778120.129704:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789778120.129896:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789778120.169651:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789778120.202475:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789778120.202735:0:5878:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789778120.202740:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789778120.202868:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789778120.208692:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789778120.208892:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789778120.209628:0:5826:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789778120.209639:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789778120.209817:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778120.211658:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789778120.212755:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789778120.213389:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789778120.214340:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789778120.214780:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789778120.222398:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789778120.223759:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789778120.223987:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789778120.224168:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789778120.224316:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789778120.224480:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789778120.224761:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789778120.224950:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789778120.225125:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789778120.225281:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789778120.225413:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789778120.225781:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789778120.225953:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789778120.226150:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789778120.226495:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789778120.235146:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789778120.235652:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789778120.235792:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789778120.235934:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789778120.236683:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789778120.236876:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789778120.237045:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789778120.238033:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789778120.238260:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789778120.238411:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789778120.238712:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789778120.238847:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789778120.239005:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789778120.239228:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789778120.239374:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789778120.241500:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789778120.241869:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789778120.242740:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789778120.268778:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789778120.321995:0:5826:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789778120.322036:0:5826:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf4301c5f988 00100000:10000000:2.0:1789778120.322044:0:5826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789778120.322760:0:5826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789778120.322774:0:5826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789778120.322786:0:5826:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789778120.322802:0:5826:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789778120.369950:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789778120.377734:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789778120.377838:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789778120.377843:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789778121.394573:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778122.420399:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778123.442307:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789778124.096585:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789778124.465893:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789778125.233915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789778125.233923:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789778125.233926:0:8:0:(import.c:65:import_set_state_nolock()) 000000006edc4fad lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789778125.233938:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006edc4fad using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1789778125.233960:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007f518e2e x1876718314851584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789778125.234144:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f518e2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314851584:0@lo:38: 00000100:00100000:3.0:1789778125.234218:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778125.234478:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314851456:0@lo:400: 00000100:00100000:1.0:1789778125.234523:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778125.235126:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851584 00000100:00100000:1.0:1789778125.235134:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851584 00000100:00100000:1.0:1789778125.235180:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789778125.235187:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ceebfa7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876718314851584:12345-0@lo:38: 00010000:00080000:1.0:1789778125.235211:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1789778125.235426:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5a1e1c1157440af6 00000004:00100000:1.0:1789778125.235474:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789778125.235648:0:5847:0:(import.c:65:import_set_state_nolock()) 000000003f4b5dc8 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789778125.235707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ceebfa7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876718314851584:12345-0@lo:38: Request processed in 519us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778125.235715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778125.236022:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851456 00000100:00100000:2.0:1789778125.236028:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851456 00000100:00100000:2.0:1789778125.236085:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789778125.236092:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002550f377 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:3312:x1876718314851456:12345-0@lo:400: 00000100:00100000:2.0:1789778125.236128:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002550f377 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:3312:x1876718314851456:12345-0@lo:400: Request processed in 38us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778125.236134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789778125.236628:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ce191bfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314851456:0@lo:400: 00010000:00080000:3.0:1789778125.236923:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007f518e2e x1876718314851584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789778135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789778125.236939:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789778125.236946:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789778125.236951:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789778125.236954:0:3309:0:(import.c:65:import_set_state_nolock()) 000000006edc4fad lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789778125.236959:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f518e2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314851584:0@lo:38: 00010000:00010000:1.0:1789778125.489530:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789778126.257390:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789778126.257399:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3eabbad800 from 3 10000000:01000000:3.0:1789778126.257404:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789778126.257453:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000002ec01bd0/0x5a1e1c1157440afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778126.257466:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000002ec01bd0/0x5a1e1c1157440afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778126.257476:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000002ec01bd0/0x5a1e1c1157440afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778126.257501:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f518e2e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314851712:0@lo:101: 00000100:00100000:3.0:1789778126.257589:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778126.257654:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000001af01b35 going to sleep for 11 seconds 00000100:00100000:0.0:1789778126.257742:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851712 00000100:00100000:0.0:1789778126.257750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851712 00000100:00100000:0.0:1789778126.257799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789778126.257807:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099e63399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5843:x1876718314851712:12345-0@lo:101: 00010000:00010000:0.0:1789778126.257829:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778126.257844:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005576c9d2/0x5a1e1c1157440b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440afd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778126.257862:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005576c9d2/0x5a1e1c1157440b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778126.257883:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005576c9d2/0x5a1e1c1157440b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778126.257890:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005576c9d2, rc 0) 00000100:00100000:0.0:1789778126.257932:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099e63399 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314851712:12345-0@lo:101: Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778126.257938:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789778126.257979:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f518e2e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314851712:0@lo:101: 00010000:00010000:0.0:1789778126.257991:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000002ec01bd0/0x5a1e1c1157440afd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778126.257999:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000002ec01bd0/0x5a1e1c1157440afd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778126.258037:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314851840:0@lo:256: 00000100:00100000:0.0:1789778126.258061:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778126.258096:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000000807fed7 going to sleep for 11 seconds 00000100:00100000:1.0:1789778126.258217:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851840 00000100:00100000:1.0:1789778126.258222:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851840 00000100:00100000:1.0:1789778126.258253:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778126.258260:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5d35a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314851840:12345-0@lo:256: 20000000:01000000:1.0:1789778126.258275:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789778126.258292:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789778126.258295:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789778126.258382:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5d35a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314851840:12345-0@lo:256: Request processed in 122us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778126.258389:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789778126.258454:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a4b6fb8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314851840:0@lo:256: 10000000:01000000:2.0:1789778126.258487:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789778126.258491:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000002ec01bd0/0x5a1e1c1157440afd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778126.258502:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000002ec01bd0/0x5a1e1c1157440afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778126.513380:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778127.542056:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789778128.535928:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2b88efd0 20000000:00000080:2.0:1789778128.535947:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3ec10ffc00 uarg=0000000000000000 20000000:01000000:2.0:1789778128.535982:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789778128.535989:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789778128.535993:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789778128.536880:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789778128.536893:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789778128.543909:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789778128.544294:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789778128.544348:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789778128.544405:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789778128.544423:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789778128.544441:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.544460:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.544467:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.544515:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.544528:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 11 pid: 5840 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778128.544540:0:6323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a3fcf52 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876718314851968:0@lo:104: 00000100:00100000:3.0:1789778128.544725:0:6323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778128.544789:0:6323:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095373094 going to sleep for 11 seconds 00000100:00100000:2.0:1789778128.544975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314851968 00000100:00100000:2.0:1789778128.544983:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314851968 00000100:00100000:2.0:1789778128.545031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778128.545039:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f54f1e82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:6323:x1876718314851968:12345-0@lo:104: 00010000:00010000:2.0:1789778128.545051:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778128.545234:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789778128.545239:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f54f1e82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:6323:x1876718314851968:12345-0@lo:104: Request processed in 201us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778128.545247:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789778128.545292:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778128.545298:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778128.545305:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e976943e already unused, calling callback (0000000096093876) 10000000:00010000:0.0:1789778128.545308:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778128.545315:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789778128.545334:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778128.545339:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789778128.545369:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778128.545374:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789778128.545393:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778128.545399:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000e976943e/0x5a1e1c1157440ac5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440acc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778128.545415:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778128.545416:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778128.545417:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778128.545475:0:6323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a3fcf52 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876718314851968:0@lo:104: 00010000:00010000:3.0:1789778128.545492:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778128.545497:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc3c9364 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314852096:0@lo:103: 00000100:00100000:1.0:1789778128.545541:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778128.545589:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852096 00000100:00100000:3.0:1789778128.545594:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852096 00010000:00010000:3.0:1789778128.545611:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 12 pid: 5840 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778128.545637:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789778128.545643:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000febedbf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3313:x1876718314852096:12345-0@lo:103: 00010000:00010000:3.0:1789778128.545654:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778128.545657:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 12 pid: 5840 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545665:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 12 pid: 5840 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545676:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440acc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440ac5 expref: 12 pid: 5840 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545692:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545698:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545708:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545713:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545719:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545724:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545728:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a3b084e0 already unused, calling callback (000000005762a2b0) 00010000:00010000:3.0:1789778128.545734:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545740:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545755:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778128.545763:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778128.545800:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000febedbf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:3313:x1876718314852096:12345-0@lo:103: Request processed in 157us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778128.545813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789778128.545927:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778128.545934:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778128.545940:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3b084e0/0x5a1e1c1157440b0b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778128.545952:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc3c9364 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314852096:0@lo:103: 00010000:00010000:0.0:1789778128.561251:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778129.585771:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778130.370638:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000abe51af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314852224:0@lo:400: 00000100:00100000:1.0:1789778130.370728:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778130.372159:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004bb69344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314852352:0@lo:400: 00000100:00100000:3.0:1789778130.372215:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778130.372278:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852352 00000100:00100000:3.0:1789778130.372286:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852352 00000100:00100000:3.0:1789778130.372326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778130.372333:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a3fcf52 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314852352:12345-0@lo:400: 00000100:00100000:3.0:1789778130.372405:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a3fcf52 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314852352:12345-0@lo:400: Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778130.372412:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789778130.372450:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004bb69344 x1876718314852352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778130.372464:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004bb69344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314852352:0@lo:400: 00000100:00100000:1.0:1789778130.377942:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852224 00000100:00100000:1.0:1789778130.377956:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852224 00000100:00100000:1.0:1789778130.378018:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789778130.378026:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000322fb2d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:3310:x1876718314852224:12345-0@lo:400: 00000100:00100000:1.0:1789778130.378143:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000322fb2d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:3310:x1876718314852224:12345-0@lo:400: Request processed in 118us (7416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778130.378150:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789778130.378195:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000abe51af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314852224:0@lo:400: 00010000:00010000:0.0:1789778130.610338:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778131.633391:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778132.657381:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778133.682192:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789778134.381677:0:6689:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789778134.381682:0:6689:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789778134.381813:0:6689:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000093d420e5 00000020:01000004:2.0:1789778134.381829:0:6689:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789778134.381840:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789778134.381853:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000001e5b3c17) 00000020:00000080:2.0:1789778134.381870:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789778134.402280:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789778134.402520:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789778134.444697:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789778134.454334:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789778134.454371:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789778134.454430:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789778134.454456:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789778134.454920:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789778134.454931:0:6689:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789778134.454939:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5a1e1c1157440b19 00000020:01000004:2.0:1789778134.454946:0:6689:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789778134.455312:0:6689:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789778134.455316:0:6689:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789778134.455321:0:6689:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789778134.455326:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789778134.455335:0:6689:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000078c6614b) 00000020:00000080:2.0:1789778134.455346:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789778134.458056:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778134.458264:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789778134.458270:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789778134.470452:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789778134.470472:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789778134.471537:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789778134.471546:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789778134.473364:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789778134.473560:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789778134.473566:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789778134.478211:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789778134.478227:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789778134.516414:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778134.516870:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789778134.516878:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789778134.519292:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789778134.519306:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789778134.520222:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789778134.520232:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789778134.530456:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789778134.530828:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789778134.530834:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789778134.540347:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789778134.540364:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789778134.625277:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778134.625486:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789778134.625575:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789778134.629415:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789778134.629430:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789778134.630174:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789778134.630200:0:6689:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789778134.630207:0:6689:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789778134.672710:0:6689:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789778134.672746:0:6689:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789778134.672750:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789778134.672751:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789778134.672753:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789778134.672754:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789778134.672755:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789778134.672756:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789778134.672757:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789778134.672758:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789778134.672759:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789778134.672760:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789778134.672762:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789778134.672765:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789778134.672768:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789778134.672769:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789778134.672770:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789778134.672775:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789778134.672776:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789778134.672777:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789778134.672778:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789778134.672779:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789778134.672779:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789778134.672780:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789778134.672781:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789778134.672804:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789778134.672820:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000207ca947 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314852480:0@lo:253: 00000100:00100000:1.0:1789778134.672907:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.673187:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab2e5fae going to sleep for 11 seconds 00000100:00100000:3.0:1789778134.673366:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852480 00000100:00100000:3.0:1789778134.673376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852480 00000100:00100000:3.0:1789778134.673434:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789778134.673442:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000739e6716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314852480:12345-0@lo:253: 20000000:01000000:3.0:1789778134.673480:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789778134.673483:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789778134.673662:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789778134.673675:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789778134.679619:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789778134.679877:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789778134.679892:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789778134.679930:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789778134.679937:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789778134.680002:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789778134.680058:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789778134.682227:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789778134.682253:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1789778134.682255:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1789778134.682288:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789778134.682305:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789778134.682356:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789778134.682364:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1789778134.682394:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789778134.682403:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789778134.682429:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789778134.682472:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789778134.683321:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789778134.683340:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:3.0:1789778134.683341:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:3.0:1789778134.683374:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789778134.683382:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789778134.683414:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789778134.683422:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:3.0:1789778134.683469:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789778134.683477:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789778134.683506:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789778134.683541:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789778134.683554:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789778134.683556:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789778134.683560:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789778134.683571:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789778134.683574:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789778134.683605:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789778134.683607:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789778134.689438:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789778134.689781:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789778134.689831:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789778134.689908:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789778134.689924:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789778134.689926:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789778134.691815:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789778134.691893:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789778134.691947:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789778134.692427:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789778134.692468:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789778134.693215:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789778134.693233:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789778134.693236:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789778134.693706:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789778134.693757:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789778134.693803:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789778134.695880:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789778134.695924:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789778134.702288:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789778134.702330:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789778134.702334:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789778134.702343:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789778134.702362:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.702381:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.702388:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.702394:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.702400:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.702439:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.702454:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 11 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778134.702466:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024130780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314852608:0@lo:104: 00000100:00100000:2.0:1789778134.702538:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789778134.702675:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.702701:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 11 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778134.702710:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ae1a4a9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314852736:0@lo:104: 00000100:00100000:2.0:1789778134.702733:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789778134.706300:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778134.706575:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.706593:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 11 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778134.706607:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b36f27b8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314852864:0@lo:104: 00000100:00100000:2.0:1789778134.706693:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.711416:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852608 00000100:00100000:1.0:1789778134.711432:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852608 00000100:00100000:1.0:1789778134.711505:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852736 00000100:00100000:1.0:1789778134.711509:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852736 00000100:00100000:1.0:1789778134.711529:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778134.711537:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096cccfbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:5839:x1876718314852608:12345-0@lo:104: 00010000:00010000:1.0:1789778134.711565:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711654:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789778134.711658:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096cccfbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:5839:x1876718314852608:12345-0@lo:104: Request processed in 123us (9121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.711681:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778134.711698:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778134.711703:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f740d352 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5839:x1876718314852736:12345-0@lo:104: 00010000:00010000:1.0:1789778134.711710:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711745:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789778134.711766:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f740d352 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5839:x1876718314852736:12345-0@lo:104: Request processed in 63us (9032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.711772:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789778134.711813:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778134.711818:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711826:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fed51e3 already unused, calling callback (0000000096093876) 10000000:00010000:1.0:1789778134.711829:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711838:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778134.711845:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778134.711850:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789778134.711894:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711901:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778134.711917:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711923:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 000000008fed51e3/0x5a1e1c1157440ad3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ada expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711937:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778134.711939:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711955:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006411da8a already unused, calling callback (0000000096093876) 10000000:00010000:1.0:1789778134.711957:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711963:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778134.711969:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778134.711974:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789778134.711986:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.711992:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778134.711997:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.712015:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 000000006411da8a/0x5a1e1c1157440a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440a6a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.712024:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778134.712026:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778134.712027:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778134.712040:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000121902e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314852992:0@lo:103: 00000100:00100000:1.0:1789778134.712097:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.712135:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778134.712141:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000774e43cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314853120:0@lo:103: 00000100:00100000:1.0:1789778134.712172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.712206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852992 00000100:00100000:1.0:1789778134.712211:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852992 00010000:00010000:1.0:1789778134.712227:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 12 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778134.712246:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314853120 00000100:00100000:1.0:1789778134.712249:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314853120 00010000:00010000:1.0:1789778134.712258:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 13 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778134.712271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778134.712276:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fbf3e54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3312:x1876718314852992:12345-0@lo:103: 00010000:00010000:1.0:1789778134.712285:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778134.712289:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 13 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.712298:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 13 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.712314:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778134.712339:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fbf3e54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3312:x1876718314852992:12345-0@lo:103: Request processed in 64us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.712345:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778134.712357:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778134.712362:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000898d31ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3312:x1876718314853120:12345-0@lo:103: 00010000:00010000:1.0:1789778134.712369:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778134.712373:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 12 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.712391:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 12 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.712401:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778134.712422:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000898d31ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3312:x1876718314853120:12345-0@lo:103: Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.712428:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778134.712458:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000774e43cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314853120:0@lo:103: 00000100:00100000:1.0:1789778134.712468:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000121902e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314852992:0@lo:103: 00010000:00010000:3.0:1789778134.712748:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778134.713207:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ffcbb1c going to sleep for 11 seconds 00010000:00010000:2.0:1789778134.713224:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012e6681c/0x5a1e1c1157440ada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440ad3 expref: 11 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778134.713235:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024130780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314852608:0@lo:104: 00010000:00010000:2.0:1789778134.713243:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000888fdf6d/0x5a1e1c1157440a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440a63 expref: 10 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778134.713250:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ae1a4a9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314852736:0@lo:104: 00000100:00100000:3.0:1789778134.717116:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314852864 00000100:00100000:3.0:1789778134.717133:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314852864 00000100:00100000:1.0:1789778134.717199:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778134.717209:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b77da36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5839:x1876718314852864:12345-0@lo:104: 00010000:00010000:1.0:1789778134.717225:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.717320:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789778134.717325:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b77da36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5839:x1876718314852864:12345-0@lo:104: Request processed in 118us (10634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.717333:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789778134.717350:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778134.717355:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.717362:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066ad9560 already unused, calling callback (0000000096093876) 10000000:00010000:1.0:1789778134.717365:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778134.717372:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b36f27b8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314852864:0@lo:104: 00010000:00010000:1.0:1789778134.717387:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778134.717393:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778134.717398:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789778134.717399:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.717438:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.717445:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778134.717470:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.717477:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 0000000066ad9560/0x5a1e1c1157440a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440a4e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.717492:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778134.717494:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778134.717495:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778134.717502:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789778134.717514:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000121902e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314853248:0@lo:103: 00000100:00100000:1.0:1789778134.717550:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.717653:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314853248 00000100:00100000:0.0:1789778134.717658:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314853248 00010000:00010000:0.0:1789778134.717685:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 10 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.717714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789778134.717720:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000774e43cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:3311:x1876718314853248:12345-0@lo:103: 00010000:00010000:0.0:1789778134.717730:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778134.717734:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 10 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717755:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 10 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717767:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e8abf0d/0x5a1e1c1157440a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440a47 expref: 10 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717779:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717785:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717797:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717804:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717809:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717814:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717818:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001ade700d already unused, calling callback (000000005762a2b0) 00010000:00010000:0.0:1789778134.717821:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717826:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717856:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.717865:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778134.717904:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000774e43cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:3311:x1876718314853248:12345-0@lo:103: Request processed in 185us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778134.717911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778134.718107:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000121902e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314853248:0@lo:103: 00010000:00010000:2.0:1789778134.718192:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.718200:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.718218:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789778134.718229:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789778134.781166:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000739e6716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+8:6689:x1876718314852480:12345-0@lo:253: Request processed in 107715us (108249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778134.781185:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778134.781212:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000207ca947 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314852480:0@lo:253: 10000000:01000000:1.0:1789778134.781229:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789778134.781232:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789778134.781234:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789778134.781252:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789778134.781254:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789778134.781255:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789778134.781257:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789778134.781258:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789778134.781260:0:6689:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789778134.781262:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789778134.781264:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789778134.781287:0:6689:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000093d420e5 from lustre-OST0000 10000000:01000000:1.0:1789778134.781316:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789778134.781318:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789778134.781326:0:6689:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3e85d019b8 local copy 10000000:01000000:1.0:1789778134.781330:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789778134.781365:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.781375:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.781383:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778134.781402:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000207ca947 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853376:0@lo:101: 00000100:00100000:1.0:1789778134.781452:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.781550:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e594995 going to sleep for 11 seconds 00000100:00100000:0.0:1789778134.784277:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314853376 00000100:00100000:0.0:1789778134.784295:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314853376 00000100:00100000:2.0:1789778134.785528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789778134.785540:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066cf90c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+8:6689:x1876718314853376:12345-0@lo:101: 00010000:00010000:2.0:1789778134.785558:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778134.785576:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440b2e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.785603:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440b2e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.785615:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b2e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.785625:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ade700d, rc 0) 00000100:00100000:2.0:1789778134.785719:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066cf90c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:6689:x1876718314853376:12345-0@lo:101: Request processed in 182us (4266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778134.785727:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789778134.785811:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000207ca947 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853376:0@lo:101: 00010000:00010000:0.0:1789778134.785828:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.785838:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.785957:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853504:0@lo:501: 00000100:00100000:0.0:1789778134.786005:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.788838:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a2aed4d going to sleep for 11 seconds 00000100:00100000:1.0:1789778134.788945:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314853504 00000100:00100000:1.0:1789778134.788956:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314853504 00000100:00100000:1.0:1789778134.789004:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789778134.789012:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c842cdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:6689:x1876718314853504:12345-0@lo:501: 00000100:00100000:1.0:1789778134.789310:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c842cdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:6689:x1876718314853504:12345-0@lo:501: Request processed in 298us (3304us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789778134.789318:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789778134.789422:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853504:0@lo:501: 10000000:01000000:0.0:1789778134.789443:0:6689:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789778134.789479:0:6689:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789778134.789485:0:6689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.789511:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.789532:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.789560:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789778134.789584:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3ec0d89800 10000000:01000000:0.0:1789778134.789588:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789778134.789593:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b3e85d019b8 10000000:01000000:0.0:1789778134.789595:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789778134.789598:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b3e85d019b8 from 1 10000000:01000000:0.0:1789778134.789601:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789778134.789630:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 000000000049f36d/0x5a1e1c1157440b3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.789638:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 000000000049f36d/0x5a1e1c1157440b3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.789646:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 000000000049f36d/0x5a1e1c1157440b3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.789672:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853632:0@lo:101: 00000100:00100000:0.0:1789778134.789722:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.789742:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e775fa going to sleep for 11 seconds 00010000:00010000:1.0:1789778134.789837:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778134.789842:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.789851:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a042d98b already unused, calling callback (0000000096093876) 10000000:00010000:1.0:1789778134.789854:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.789862:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778134.789868:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778134.789873:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789778134.789892:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.789898:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778134.789926:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.789933:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: 00000000a042d98b/0x5a1e1c1157440b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5a1e1c1157440b35 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.789950:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778134.789952:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778134.789954:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778134.789960:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778134.789971:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000121902e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314853760:0@lo:103: 00000100:00100000:1.0:1789778134.790001:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.790040:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314853760 00000100:00100000:1.0:1789778134.790045:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314853760 00000100:00100000:1.0:1789778134.790111:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789778134.790119:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d080ba74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:3310:x1876718314853760:12345-0@lo:103: 00010000:00010000:1.0:1789778134.790130:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778134.790143:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ade700d/0x5a1e1c1157440b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440b2e expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.790158:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778134.790186:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d080ba74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+8:3310:x1876718314853760:12345-0@lo:103: Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.790192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789778134.790216:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000121902e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314853760:0@lo:103: 00000100:00100000:1.0:1789778134.790237:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314853632 00000100:00100000:1.0:1789778134.790241:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314853632 00000100:00100000:1.0:1789778134.790257:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789778134.790262:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e67fba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+8:6689:x1876718314853632:12345-0@lo:101: 00010000:00010000:1.0:1789778134.790271:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778134.790281:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440b43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440b3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.790298:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440b43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440b3c expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.790307:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5a09b44/0x5a1e1c1157440b43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b3c expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.790314:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5a09b44, rc 0) 00000100:00100000:1.0:1789778134.790341:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e67fba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:6689:x1876718314853632:12345-0@lo:101: Request processed in 79us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.790353:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789778134.790453:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853632:0@lo:101: 00010000:00010000:0.0:1789778134.790466:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 000000000049f36d/0x5a1e1c1157440b3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b43 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.790473:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 000000000049f36d/0x5a1e1c1157440b3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440b43 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778134.790509:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789778134.790525:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 000000000049f36d/0x5a1e1c1157440b3c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b43 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.790532:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 000000000049f36d/0x5a1e1c1157440b3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b43 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778134.790539:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789778134.790543:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789778134.790548:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789778134.790550:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789778134.790564:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000ef373fce/0x5a1e1c1157440b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.790571:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000ef373fce/0x5a1e1c1157440b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.790577:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000ef373fce/0x5a1e1c1157440b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.790588:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853888:0@lo:101: 00000100:00100000:0.0:1789778134.790620:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.790639:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e775fa going to sleep for 11 seconds 00000100:00100000:1.0:1789778134.790743:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314853888 00000100:00100000:1.0:1789778134.790748:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314853888 00000100:00100000:1.0:1789778134.790768:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789778134.790773:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071199753 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+9:6689:x1876718314853888:12345-0@lo:101: 00010000:00010000:1.0:1789778134.790780:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778134.790787:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440b4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.790799:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.790806:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb4363c0/0x5a1e1c1157440b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.790812:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb4363c0, rc 0) 00000100:00100000:1.0:1789778134.790846:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071199753 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314853888:12345-0@lo:101: Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.790852:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789778134.791012:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314853888:0@lo:101: 00010000:00010000:0.0:1789778134.791022:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000ef373fce/0x5a1e1c1157440b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.791029:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000ef373fce/0x5a1e1c1157440b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.791158:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854016:0@lo:501: 00000100:00100000:0.0:1789778134.791189:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.791205:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e775fa going to sleep for 11 seconds 00000100:00100000:1.0:1789778134.791262:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854016 00000100:00100000:1.0:1789778134.791266:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854016 00000100:00100000:1.0:1789778134.791282:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789778134.791288:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6a4a9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854016:12345-0@lo:501: 00000100:00100000:1.0:1789778134.791683:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6a4a9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854016:12345-0@lo:501: Request processed in 392us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.791692:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789778134.791805:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854016:0@lo:501: 00000100:00100000:0.0:1789778134.791841:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854144:0@lo:503: 00000100:00100000:0.0:1789778134.791877:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.791904:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e775fa going to sleep for 11 seconds 00000100:00100000:1.0:1789778134.791945:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854144 00000100:00100000:1.0:1789778134.791949:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854144 00000100:00100000:1.0:1789778134.791970:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789778134.791975:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd45aed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854144:12345-0@lo:503: 00000100:00100000:1.0:1789778134.792135:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd45aed8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854144:12345-0@lo:503: Request processed in 160us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.792142:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789778134.792207:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854144:0@lo:503: 00000040:00080000:0.0:1789778134.792470:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789778134.792814:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854272:0@lo:502: 00000100:00100000:0.0:1789778134.792866:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.792900:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e775fa going to sleep for 11 seconds 00000100:00100000:2.0:1789778134.792964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854272 00000100:00100000:2.0:1789778134.792969:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854272 00000100:00100000:2.0:1789778134.792997:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789778134.793003:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005be5130e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854272:12345-0@lo:502: 00000100:00100000:2.0:1789778134.793170:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005be5130e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854272:12345-0@lo:502: Request processed in 167us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778134.793177:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789778134.793264:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854272:0@lo:502: 00000040:00080000:0.0:1789778134.793486:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789778134.793543:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789778134.793573:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789778134.793621:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789778134.793655:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789778134.793707:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789778134.793727:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854400:0@lo:502: 00000100:00100000:0.0:1789778134.793761:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.793789:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e775fa going to sleep for 11 seconds 00000100:00100000:2.0:1789778134.793842:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854400 00000100:00100000:2.0:1789778134.793847:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854400 00000100:00100000:2.0:1789778134.793866:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789778134.793871:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6748375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854400:12345-0@lo:502: 00000100:00100000:2.0:1789778134.793990:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6748375 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854400:12345-0@lo:502: Request processed in 118us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778134.793997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789778134.794223:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854400:0@lo:502: 00000040:00080000:0.0:1789778134.794297:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789778134.794312:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1789778134.794825:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789778134.794833:0:6707:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789778134.794840:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778134.794842:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789778134.794847:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778134.794860:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000607667c1) 00000020:00000080:0.0:1789778134.794880:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789778134.794886:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789778134.794941:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000093d420e5 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789778134.794948:0:6707:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789778134.794955:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5a1e1c1157440b5f 00010000:00010000:1.0:1789778134.799628:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789778134.799927:0:6707:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789778134.802699:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789778134.803144:0:6707:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789778134.810555:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789778134.811585:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789778134.813269:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789778134.813279:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778134.813284:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778134.813286:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789778134.813289:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778134.813293:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778134.813294:0:6707:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789778134.813297:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789778134.813299:0:6707:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789778134.813347:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778134.813350:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778134.813351:0:6707:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789778134.813354:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789778134.813499:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789778134.813527:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789778134.813545:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: 00000000ef373fce/0x5a1e1c1157440b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.813558:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: 00000000ef373fce/0x5a1e1c1157440b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778134.813566:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ec0d89800 from 1 10000000:01000000:0.0:1789778134.813569:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778134.813604:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: 00000000ad50d336/0x5a1e1c1157440b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.813612:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: 00000000ad50d336/0x5a1e1c1157440b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.813622:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: 00000000ad50d336/0x5a1e1c1157440b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.813641:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854528:0@lo:101: 00000100:00100000:0.0:1789778134.813730:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.813817:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000310d44ea going to sleep for 11 seconds 00000100:00100000:2.0:1789778134.816310:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854528 00000100:00100000:2.0:1789778134.816324:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854528 00000100:00100000:2.0:1789778134.816383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789778134.816394:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fdb5fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+10:6689:x1876718314854528:12345-0@lo:101: 00010000:00010000:2.0:1789778134.816409:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778134.816425:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ae637ce/0x5a1e1c1157440b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440b66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.816449:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ae637ce/0x5a1e1c1157440b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.816458:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ae637ce/0x5a1e1c1157440b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.816466:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ae637ce, rc 0) 00000100:00100000:2.0:1789778134.822142:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fdb5fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314854528:12345-0@lo:101: Request processed in 5745us (8405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778134.822154:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789778134.822365:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f0d3359 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854528:0@lo:101: 00010000:00010000:2.0:1789778134.822386:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: 00000000ad50d336/0x5a1e1c1157440b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778134.822410:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: 00000000ad50d336/0x5a1e1c1157440b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778134.822516:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6be86cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854656:0@lo:501: 00000100:00100000:2.0:1789778134.822573:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778134.823812:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cad477dc going to sleep for 11 seconds 00000100:00100000:3.0:1789778134.823867:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854656 00000100:00100000:3.0:1789778134.823876:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854656 00000100:00100000:3.0:1789778134.823954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789778134.823972:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a73059a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314854656:12345-0@lo:501: 00000100:00100000:3.0:1789778134.824226:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a73059a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314854656:12345-0@lo:501: Request processed in 264us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778134.824234:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789778134.824309:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6be86cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854656:0@lo:501: 00000100:00100000:2.0:1789778134.824348:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6be86cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854784:0@lo:503: 00000100:00100000:2.0:1789778134.824399:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778134.824824:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cad477dc going to sleep for 11 seconds 00000100:00100000:1.0:1789778134.824865:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854784 00000100:00100000:1.0:1789778134.824870:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854784 00000100:00100000:1.0:1789778134.824892:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789778134.824898:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071385312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314854784:12345-0@lo:503: 00000100:00100000:1.0:1789778134.825379:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071385312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314854784:12345-0@lo:503: Request processed in 480us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778134.825394:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789778134.825744:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6be86cd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854784:0@lo:503: 00000040:00080000:2.0:1789778134.826032:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789778134.827947:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006018a2ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854912:0@lo:502: 00000100:00100000:3.0:1789778134.828350:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778134.828422:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aa312d18 going to sleep for 11 seconds 00000100:00100000:0.0:1789778134.828473:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314854912 00000100:00100000:0.0:1789778134.828481:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314854912 00000100:00100000:0.0:1789778134.828548:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789778134.828557:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021edce1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314854912:12345-0@lo:502: 00000100:00100000:0.0:1789778134.828809:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021edce1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314854912:12345-0@lo:502: Request processed in 254us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778134.828817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789778134.828899:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006018a2ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314854912:0@lo:502: 00000040:00080000:3.0:1789778134.829229:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789778134.829282:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789778134.829310:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006018a2ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855040:0@lo:502: 00000100:00100000:3.0:1789778134.829352:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778134.829647:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce80d62e going to sleep for 11 seconds 00000100:00100000:0.0:1789778134.829730:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855040 00000100:00100000:0.0:1789778134.829735:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855040 00000100:00100000:0.0:1789778134.829759:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789778134.829766:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009abf1885 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314855040:12345-0@lo:502: 00000100:00100000:0.0:1789778134.829904:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009abf1885 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314855040:12345-0@lo:502: Request processed in 138us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778134.829911:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789778134.830040:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006018a2ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855040:0@lo:502: 00000040:00080000:3.0:1789778134.830156:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789778134.830166:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789778134.830837:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778134.830847:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778134.830850:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789778134.830856:0:6711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ec0d89800 00000020:00000080:3.0:1789778134.830858:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789778134.830892:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778134.830895:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778134.830897:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789778134.830900:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789778134.833367:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789778134.833412:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789778134.833438:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.833451:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778134.833517:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789778134.833521:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3ec0d89800 10000000:01000000:0.0:1789778134.833524:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3ec0d89800 10000000:01000000:0.0:1789778134.833528:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789778134.833540:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3ec0d89800 from 1 10000000:01000000:0.0:1789778134.833542:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789778134.833576:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.833584:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.833595:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.833615:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855168:0@lo:101: 00000100:00100000:0.0:1789778134.833696:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.833741:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931480 going to sleep for 11 seconds 00000100:00100000:3.0:1789778134.834214:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855168 00000100:00100000:3.0:1789778134.834222:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855168 00000100:00100000:3.0:1789778134.834274:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778134.834284:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314855168:12345-0@lo:101: 00010000:00010000:3.0:1789778134.834298:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778134.834311:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440b74 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778134.834335:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778134.834345:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778134.834355:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150ea00, rc 0) 00000100:00100000:3.0:1789778134.834403:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855168:12345-0@lo:101: Request processed in 121us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778134.834410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778134.834451:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855168:0@lo:101: 00010000:00010000:3.0:1789778134.834475:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778134.834483:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778134.834574:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855296:0@lo:501: 00000100:00100000:3.0:1789778134.834607:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778134.834624:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789778134.834639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855296 00000100:00100000:3.0:1789778134.834642:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855296 00000100:00100000:3.0:1789778134.834658:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789778134.834675:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855296:12345-0@lo:501: 00000100:00100000:3.0:1789778134.834878:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855296:12345-0@lo:501: Request processed in 202us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778134.834885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789778134.834908:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855296:0@lo:501: 00000100:00100000:3.0:1789778134.834931:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855424:0@lo:503: 00000100:00100000:3.0:1789778134.835134:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778134.835153:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789778134.835171:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855424 00000100:00100000:3.0:1789778134.835174:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855424 00000100:00100000:3.0:1789778134.835190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789778134.835195:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855424:12345-0@lo:503: 00000100:00100000:3.0:1789778134.835383:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855424:12345-0@lo:503: Request processed in 187us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778134.835391:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789778134.835500:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855424:0@lo:503: 00000040:00080000:2.0:1789778134.835753:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789778134.835803:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855552:0@lo:502: 00000100:00100000:2.0:1789778134.835840:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778134.835868:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9075ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778134.835917:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855552 00000100:00100000:3.0:1789778134.835922:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855552 00000100:00100000:3.0:1789778134.836048:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789778134.836055:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855552:12345-0@lo:502: 00000100:00100000:3.0:1789778134.836233:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855552:12345-0@lo:502: Request processed in 178us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778134.836239:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789778134.836599:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855552:0@lo:502: 00000040:00080000:2.0:1789778134.836863:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789778134.836912:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789778134.836944:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789778134.837115:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789778134.837155:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789778134.837216:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789778134.837253:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789778134.837298:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789778134.837357:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789778134.837391:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789778134.837418:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789778134.837460:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789778134.837493:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789778134.837524:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789778134.837568:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789778134.837598:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789778134.837623:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789778134.837671:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789778134.837707:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789778134.837740:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789778134.837786:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789778134.837834:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789778134.837868:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789778134.837915:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789778134.837952:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789778134.838378:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789778134.838428:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789778134.838473:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789778134.838512:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855680:0@lo:502: 00000100:00100000:1.0:1789778134.838588:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.838675:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea1fb2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778134.838714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855680 00000100:00100000:0.0:1789778134.838722:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855680 00000100:00100000:0.0:1789778134.838797:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789778134.838806:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855680:12345-0@lo:502: 00000100:00100000:0.0:1789778134.839110:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855680:12345-0@lo:502: Request processed in 304us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778134.839118:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789778134.839207:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855680:0@lo:502: 00000040:00080000:1.0:1789778134.839275:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789778134.839286:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789778134.839795:0:6712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789778134.839820:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b3ebf7d0000) 00000020:00000080:2.0:1789778134.839841:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789778134.839923:0:6712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ec0d89800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789778134.839927:0:6712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3ec0d89800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789778134.839929:0:6712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ec0d89800 3 00010000:00080000:2.0:1789778134.839955:0:6712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3ebf7dd000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.145@tcp at head 00010000:00010000:2.0:1789778134.842144:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789778134.843290:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789778134.843330:0:6712:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789778134.843343:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5a1e1c1157440b89 00000100:00080000:3.0:1789778134.843353:0:6712:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789778134.843359:0:6712:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3ebf7dd000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1789778134.843392:0:6712:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3e987e6680 x1876718314855808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789778134.843423:0:6712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789778134.843492:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876718314855808:0@lo:38: 00000100:00100000:1.0:1789778134.843563:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778134.843733:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855808 00000100:00100000:3.0:1789778134.843743:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855808 00000100:00100000:3.0:1789778134.843783:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789778134.843790:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876718314855808:12345-0@lo:38: 00010000:00080000:3.0:1789778134.843814:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1789778134.843863:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5a1e1c1157440b90 00000004:00100000:3.0:1789778134.843881:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789778134.843914:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789778134.844092:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876718314855808:12345-0@lo:38: Request processed in 299us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778134.844099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789778134.844233:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789778134.845107:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789778134.845136:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789778134.845158:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.845170:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789778134.845224:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789778134.845230:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789778134.845231:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778134.845232:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778134.845233:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778134.845234:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778134.845236:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778134.845237:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789778134.845238:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789778134.845240:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778134.845241:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789778134.845245:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789778134.845248:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789778134.845249:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789778134.845250:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778134.845251:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778134.845252:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778134.845253:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778134.845254:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778134.845255:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789778134.845255:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789778134.845256:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778134.845257:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789778134.845279:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789778134.845293:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855936:0@lo:253: 00010000:00080000:1.0:1789778134.848498:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3e987e6680 x1876718314855808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789778144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778134.848513:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789778134.848523:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789778134.848530:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789778134.848536:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789778134.848539:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789778134.848546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876718314855808:0@lo:38: 00000100:00100000:1.0:1789778134.848580:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314856064:0@lo:400: 00000100:00100000:1.0:1789778134.848644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778134.849167:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856064 00000100:00100000:2.0:1789778134.849174:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856064 00000100:00100000:2.0:1789778134.849212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778134.849220:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314856064:12345-0@lo:400: 00000100:00100000:2.0:1789778134.849281:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314856064:12345-0@lo:400: Request processed in 61us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778134.849294:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789778134.849585:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3eb581ed80 x1876718314856064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778134.849598:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314856064:0@lo:400: 00000100:00100000:3.0:1789778134.851775:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778134.851831:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931600 going to sleep for 11 seconds 00000100:00100000:0.0:1789778134.851886:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314855936 00000100:00100000:0.0:1789778134.851895:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314855936 00000100:00100000:0.0:1789778134.851945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789778134.851955:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6689:x1876718314855936:12345-0@lo:253: 20000000:01000000:0.0:1789778134.852090:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789778134.852105:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789778134.867619:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789778134.867640:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789778134.867700:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789778134.867706:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789778134.867727:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.867758:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e80031600/0x5a1e1c1157440b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.867766:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.867803:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e80031600/0x5a1e1c1157440b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778134.867818:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e80031600/0x5a1e1c1157440b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 12 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778134.867832:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876718314856192:0@lo:104: 00000100:00100000:1.0:1789778134.867897:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778134.867956:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658180 going to sleep for 11 seconds 00000100:00100000:0.0:1789778134.868098:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856192 00000100:00100000:0.0:1789778134.868105:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856192 00000100:00100000:0.0:1789778134.868148:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789778134.868157:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5861:x1876718314856192:12345-0@lo:104: 00010000:00010000:0.0:1789778134.868176:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.868229:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789778134.868236:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5861:x1876718314856192:12345-0@lo:104: Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778134.868242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789778134.868263:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778134.868269:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.868277:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f400 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:0.0:1789778134.868281:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.868289:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789778134.868296:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778134.868302:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789778134.868332:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.868338:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789778134.868356:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.868364:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f400/0x5a1e1c1157440afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b04 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.868387:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778134.868389:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778134.868391:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778134.868403:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314856320:0@lo:103: 00000100:00100000:0.0:1789778134.868435:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778134.868498:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876718314856192:0@lo:104: 00010000:00010000:0.0:1789778134.868517:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.869208:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856320 00000100:00100000:0.0:1789778134.869216:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856320 00010000:00010000:0.0:1789778134.869239:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e80031600/0x5a1e1c1157440b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 13 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.869277:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789778134.869285:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3313:x1876718314856320:12345-0@lo:103: 00010000:00010000:0.0:1789778134.869297:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778134.869301:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e80031600/0x5a1e1c1157440b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 13 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869312:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e80031600/0x5a1e1c1157440b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 13 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869327:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e80031600/0x5a1e1c1157440b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440afd expref: 13 pid: 5840 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869340:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869360:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789778134.869373:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003767843s 00010000:00010000:0.0:1789778134.869378:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869384:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869391:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869398:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869404:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778134.869408:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869415:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869430:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869440:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778134.869482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3313:x1876718314856320:12345-0@lo:103: Request processed in 197us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778134.869489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789778134.869578:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314856320:0@lo:103: 00010000:00010000:0.0:1789778134.869599:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869608:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778134.869614:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440b97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778134.878902:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:6689:x1876718314855936:12345-0@lo:253: Request processed in 26938us (27119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778134.878915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789778134.879056:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6689:1876718314855936:0@lo:253: 10000000:01000000:3.0:1789778134.879098:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789778134.879102:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789778134.879103:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789778134.879105:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789778134.879106:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789778134.879107:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789778134.879109:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789778134.879110:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789778134.879112:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789778134.879114:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789778134.879115:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789778134.879117:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789778134.879132:0:6689:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789778134.883925:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778134.885855:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789778134.886298:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778134.886498:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789778134.886867:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778134.887252:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789778134.888127:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789778135.061966:0:6689:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789778135.061973:0:6689:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789778135.062013:0:6689:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789778135.062090:0:6689:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789778135.062120:0:6689:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789778135.062145:0:6689:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:2.0:1789778135.537179:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789778135.537187:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3eabbad800 from 21 10000000:01000000:2.0:1789778135.537193:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789778135.537236:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778135.537248:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778135.537259:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778135.537281:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314856448:0@lo:101: 00000100:00100000:2.0:1789778135.537359:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.537405:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf9410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778135.539839:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856448 00000100:00100000:0.0:1789778135.539855:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856448 00000100:00100000:0.0:1789778135.539927:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789778135.539938:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:5843:x1876718314856448:12345-0@lo:101: 00010000:00010000:0.0:1789778135.539964:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778135.539984:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440b9e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.540010:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.540021:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.540043:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757800, rc 0) 00000100:00100000:0.0:1789778135.540152:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314856448:12345-0@lo:101: Request processed in 216us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.540170:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789778135.540829:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314856448:0@lo:101: 00010000:00010000:2.0:1789778135.540854:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778135.540865:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778135.540959:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314856576:0@lo:501: 00000100:00100000:2.0:1789778135.541008:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.541049:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf9410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778135.542121:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856576 00000100:00100000:0.0:1789778135.542141:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856576 00000100:00100000:0.0:1789778135.542204:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789778135.542213:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314856576:12345-0@lo:501: 00000100:00100000:0.0:1789778135.542867:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314856576:12345-0@lo:501: Request processed in 653us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.542875:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789778135.544217:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314856576:0@lo:501: 00000100:00100000:2.0:1789778135.544276:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314856704:0@lo:503: 00000100:00100000:2.0:1789778135.544662:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.544703:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf9410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778135.545083:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856704 00000100:00100000:0.0:1789778135.545921:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856704 00000100:00100000:1.0:1789778135.547638:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789778135.547660:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314856704:12345-0@lo:503: 00000100:00100000:1.0:1789778135.549119:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314856704:12345-0@lo:503: Request processed in 1464us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.549131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789778135.549783:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314856704:0@lo:503: 00000100:00100000:2.0:1789778135.550011:0:6735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6735:1876718314856832:0@lo:502: 00000100:00100000:2.0:1789778135.550080:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.550576:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856832 00000100:00100000:0.0:1789778135.550583:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856832 00000100:00100000:0.0:1789778135.550620:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789778135.550629:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6735:x1876718314856832:12345-0@lo:502: 00000100:00100000:0.0:1789778135.550945:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6735:x1876718314856832:12345-0@lo:502: Request processed in 316us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.551082:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789778135.551747:0:6735:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941900 going to sleep for 11 seconds 00000100:00100000:0.0:1789778135.551776:0:6735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6735:1876718314856832:0@lo:502: 00000100:00100000:1.0:1789778135.551873:0:6735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6735:1876718314856960:0@lo:502: 00000100:00100000:1.0:1789778135.551923:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.552000:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314856960 00000100:00100000:0.0:1789778135.552007:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314856960 00000100:00100000:0.0:1789778135.552044:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789778135.552053:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6735:x1876718314856960:12345-0@lo:502: 00000100:00100000:1.0:1789778135.552079:0:6735:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931600 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.552533:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:6735:x1876718314856960:12345-0@lo:502: Request processed in 481us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.552541:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789778135.552636:0:6735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6735:1876718314856960:0@lo:502: 00000040:00080000:2.0:1789778135.552670:0:6735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789778135.552903:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789778135.552928:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789778135.552939:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.553021:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778135.553031:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789778135.553034:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3eabbad800 from 4 10000000:01000000:1.0:1789778135.553037:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789778135.553138:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.553146:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.553156:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778135.553552:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857088:0@lo:101: 00000100:00100000:1.0:1789778135.553599:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.553681:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e909313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778135.554290:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857088 00000100:00100000:2.0:1789778135.554404:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857088 00000100:00100000:1.0:1789778135.554569:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789778135.554579:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314857088:12345-0@lo:101: 00010000:00010000:1.0:1789778135.554593:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778135.554609:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440bac expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.554633:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.554673:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.554681:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2800, rc 0) 00000100:00100000:1.0:1789778135.558401:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314857088:12345-0@lo:101: Request processed in 3814us (4791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.558414:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789778135.562283:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857088:0@lo:101: 00010000:00010000:1.0:1789778135.562388:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.562402:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778135.562471:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857216:0@lo:256: 00000100:00100000:1.0:1789778135.562540:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.562585:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e909313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.562607:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857216 00000100:00100000:1.0:1789778135.562613:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857216 00000100:00100000:1.0:1789778135.562673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789778135.562683:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314857216:12345-0@lo:256: 20000000:01000000:1.0:1789778135.562704:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789778135.562722:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789778135.562725:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789778135.562812:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314857216:12345-0@lo:256: Request processed in 130us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.562820:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789778135.562864:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857216:0@lo:256: 10000000:01000000:1.0:1789778135.562902:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789778135.562910:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.562919:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778135.562929:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789778135.562931:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789778135.562934:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789778135.563463:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.563472:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.563481:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778135.563494:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857344:0@lo:101: 00000100:00100000:1.0:1789778135.563522:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.563556:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e909313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778135.564211:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857344 00000100:00100000:3.0:1789778135.564220:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857344 00000100:00100000:3.0:1789778135.564268:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789778135.564277:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314857344:12345-0@lo:101: 00010000:00010000:3.0:1789778135.564289:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778135.564517:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440bba expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778135.564542:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778135.564552:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778135.564572:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150e200, rc 0) 00000100:00100000:3.0:1789778135.564623:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314857344:12345-0@lo:101: Request processed in 346us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778135.564629:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789778135.564904:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857344:0@lo:101: 00010000:00010000:1.0:1789778135.564921:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.564931:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778135.565008:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857472:0@lo:501: 00000100:00100000:1.0:1789778135.565037:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.565057:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e909313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778135.565361:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857472 00000100:00100000:0.0:1789778135.565367:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857472 00000100:00100000:0.0:1789778135.565406:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789778135.565415:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314857472:12345-0@lo:501: 00000100:00100000:0.0:1789778135.565823:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314857472:12345-0@lo:501: Request processed in 409us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.565831:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789778135.567608:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857472:0@lo:501: 00000100:00100000:1.0:1789778135.567682:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857600:0@lo:503: 00000100:00100000:1.0:1789778135.567756:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.567799:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e909313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778135.567809:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857600 00000100:00100000:0.0:1789778135.567817:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857600 00000100:00100000:0.0:1789778135.567870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789778135.567881:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314857600:12345-0@lo:503: 00000100:00100000:0.0:1789778135.569682:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314857600:12345-0@lo:503: Request processed in 1796us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.569695:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789778135.570940:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314857600:0@lo:503: 00000100:00100000:0.0:1789778135.578776:0:6736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6736:1876718314857728:0@lo:502: 00000100:00100000:0.0:1789778135.578859:0:6736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.578909:0:6736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0367600 going to sleep for 11 seconds 00000100:00100000:3.0:1789778135.580532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857728 00000100:00100000:3.0:1789778135.580545:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857728 00000100:00100000:3.0:1789778135.580606:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789778135.580616:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:6736:x1876718314857728:12345-0@lo:502: 00000100:00100000:3.0:1789778135.580961:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:6736:x1876718314857728:12345-0@lo:502: Request processed in 333us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778135.580969:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789778135.582098:0:6736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6736:1876718314857728:0@lo:502: 00000020:01000000:0.0:1789778135.582144:0:6736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789778135.582153:0:6736:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789778135.582163:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778135.582166:0:6736:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789778135.582173:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789778135.582177:0:6736:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:0.0:1789778135.582203:0:6736:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789778135.582207:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778135.582224:0:6736:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b3eb97719b8) 00000020:00000080:0.0:1789778135.582256:0:6736:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789778135.582265:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789778135.582358:0:6736:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789778135.582363:0:6736:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789778135.582373:0:6736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157440bcf 00010000:00080000:0.0:1789778135.582408:0:6736:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3ebf7cf000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1789778135.582632:0:6736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789778135.639713:0:6736:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789778135.639732:0:6736:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789778135.640562:0:6736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789778135.640736:0:6736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789778135.640779:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789778135.640829:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789778135.652028:0:6738:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778135.652038:0:6738:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789778135.655913:0:6736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789778135.655930:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789778135.655978:0:6736:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789778135.656001:0:6736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157440bd6 00000100:00080000:1.0:1789778135.656011:0:6736:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789778135.656017:0:6736:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b3ebf7cf000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1789778135.656052:0:6736:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3eb5df2680 x1876718314857856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789778135.656103:0:6736:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789778135.656160:0:6736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778135.656165:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778135.656167:0:6736:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789778135.656170:0:6736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778135.656174:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778135.656176:0:6736:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789778135.656179:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789778135.656182:0:6736:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789778135.656209:0:6736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6736:1876718314857984:0@lo:502: 00000100:00100000:1.0:1789778135.656410:0:6736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.656467:0:6736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86467240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.656528:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314858112:0@lo:400: 00000100:00100000:1.0:1789778135.656556:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.656578:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778135.656584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314858240:0@lo:400: 00000100:00100000:1.0:1789778135.656604:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.656633:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314858112 00000100:00100000:1.0:1789778135.656640:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314858112 00000100:00100000:1.0:1789778135.656685:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314858240 00000100:00100000:1.0:1789778135.656688:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314858240 00000100:00100000:1.0:1789778135.656713:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778135.656721:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314858112:12345-0@lo:400: 00000100:00100000:1.0:1789778135.656769:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314858112:12345-0@lo:400: Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.656775:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778135.656791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778135.656797:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314858240:12345-0@lo:400: 00000100:00100000:1.0:1789778135.656823:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314858240:12345-0@lo:400: Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.656829:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789778135.656862:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3eb5df2d80 x1876718314858240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778135.656875:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314858240:0@lo:400: 00010000:00080000:1.0:1789778135.656885:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3eb5df3100 x1876718314858112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778135.656894:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314858112:0@lo:400: 00000100:00100000:0.0:1789778135.657001:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314857856:0@lo:8: 00000100:00100000:0.0:1789778135.657034:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.657091:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857984 00000100:00100000:0.0:1789778135.657095:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857984 00000100:00100000:0.0:1789778135.657124:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789778135.657131:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:6736:x1876718314857984:12345-0@lo:502: 00000100:00100000:0.0:1789778135.657358:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:6736:x1876718314857984:12345-0@lo:502: Request processed in 226us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.657365:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789778135.657412:0:6736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6736:1876718314857984:0@lo:502: 00000020:01000000:0.0:1789778135.657433:0:6736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778135.657438:0:6736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778135.657440:0:6736:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789778135.657445:0:6736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789778135.657558:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789778135.657573:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789778135.657588:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.657598:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778135.657608:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789778135.657611:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3eabbad800 from 1 10000000:01000000:0.0:1789778135.657613:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778135.657635:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.657642:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.657664:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778135.657677:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314858368:0@lo:101: 00000100:00100000:0.0:1789778135.657703:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.657721:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957da900 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.657907:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314858368 00000100:00100000:1.0:1789778135.657913:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314858368 00000100:00100000:2.0:1789778135.658137:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314857856 00000100:00100000:2.0:1789778135.658142:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314857856 00000100:00100000:2.0:1789778135.658166:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778135.658173:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876718314857856:12345-0@lo:8: 00010000:00080000:2.0:1789778135.658200:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1789778135.658226:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157440be4 00002000:00100000:2.0:1789778135.658273:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b3ebf7df800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789778135.658277:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789778135.658281:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789778135.658417:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789778135.658547:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789778135.658569:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778135.658623:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876718314857856:12345-0@lo:8: Request processed in 448us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778135.658629:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778135.658665:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789778135.658674:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314858368:12345-0@lo:101: 00010000:00010000:2.0:1789778135.658683:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778135.658697:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440bdd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778135.658716:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778135.658726:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778135.658734:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657000, rc 0) 00000100:00100000:2.0:1789778135.658765:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314858368:12345-0@lo:101: Request processed in 93us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778135.658771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789778135.658819:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9b3eb5df2680 x1876718314857856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789778145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778135.658829:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789778135.658841:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789778135.658847:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789778135.658852:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789778135.658854:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7cf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789778135.658866:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789778135.658871:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314857856:0@lo:8: 00000100:00100000:2.0:1789778135.658899:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314858368:0@lo:101: 00010000:00010000:2.0:1789778135.658913:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778135.658921:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778135.660452:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314858496:0@lo:501: 00000100:00100000:2.0:1789778135.660510:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.660540:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941540 going to sleep for 11 seconds 00000100:00100000:2.0:1789778135.660565:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314858496 00000100:00100000:2.0:1789778135.660571:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314858496 00000100:00100000:2.0:1789778135.660613:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789778135.660622:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314858496:12345-0@lo:501: 00000100:00100000:2.0:1789778135.660905:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314858496:12345-0@lo:501: Request processed in 283us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778135.660913:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789778135.662430:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314858496:0@lo:501: 00000100:00100000:2.0:1789778135.662502:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314858624:0@lo:503: 00000100:00100000:2.0:1789778135.662557:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.662608:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941540 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.663080:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314858624 00000100:00100000:1.0:1789778135.663088:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314858624 00000100:00100000:1.0:1789778135.663127:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789778135.663137:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314858624:12345-0@lo:503: 00000100:00100000:1.0:1789778135.663478:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314858624:12345-0@lo:503: Request processed in 340us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.663486:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789778135.663747:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789778135.664132:0:6738:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789778135.664301:0:6738:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190622224148ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789778135.665583:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314858624:0@lo:503: 00000100:00100000:0.0:1789778135.673616:0:6740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6740:1876718314858752:0@lo:502: 00000100:00100000:0.0:1789778135.673721:0:6740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.673780:0:6740:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.677971:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314858752 00000100:00100000:1.0:1789778135.677987:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314858752 00000100:00100000:1.0:1789778135.678058:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789778135.678095:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:6740:x1876718314858752:12345-0@lo:502: 00000100:00100000:1.0:1789778135.678421:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:6740:x1876718314858752:12345-0@lo:502: Request processed in 327us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.678429:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789778135.678503:0:6740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6740:1876718314858752:0@lo:502: 00000020:01000000:1.0:1789778135.678538:0:6740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778135.678548:0:6740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778135.678551:0:6740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789778135.678559:0:6740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3eabbad800 00000020:00000080:1.0:1789778135.678561:0:6740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789778135.678598:0:6740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6740:1876718314858880:0@lo:502: 00000100:00100000:1.0:1789778135.678642:0:6740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.678685:0:6740:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e87637840 going to sleep for 11 seconds 00000100:00100000:0.0:1789778135.678850:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314858880 00000100:00100000:0.0:1789778135.678855:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314858880 00000100:00100000:0.0:1789778135.678882:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789778135.678890:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:6740:x1876718314858880:12345-0@lo:502: 00000100:00100000:0.0:1789778135.679028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:6740:x1876718314858880:12345-0@lo:502: Request processed in 139us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.679036:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789778135.679485:0:6740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:6740:1876718314858880:0@lo:502: 00000020:01000000:1.0:1789778135.679509:0:6740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778135.679520:0:6740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778135.679522:0:6740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789778135.679526:0:6740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789778135.679703:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789778135.679727:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789778135.679738:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.679749:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778135.679759:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789778135.679762:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b3e85d019b8 from 1 10000000:01000000:0.0:1789778135.679765:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789778135.679795:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.679803:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778135.679812:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778135.679826:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314859008:0@lo:101: 00000100:00100000:0.0:1789778135.679866:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.679900:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957da780 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.679966:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859008 00000100:00100000:1.0:1789778135.679971:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859008 00000100:00100000:1.0:1789778135.680003:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789778135.680010:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314859008:12345-0@lo:101: 00010000:00010000:1.0:1789778135.680020:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778135.680032:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440bf2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.680055:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.680091:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.680100:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3c00, rc 0) 00000100:00100000:1.0:1789778135.680133:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314859008:12345-0@lo:101: Request processed in 123us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778135.680139:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789778135.680170:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314859008:0@lo:101: 00010000:00010000:1.0:1789778135.680181:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.680191:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778135.680235:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314859136:0@lo:501: 00000100:00100000:1.0:1789778135.680268:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778135.680282:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e87637c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778135.680306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859136 00000100:00100000:1.0:1789778135.680310:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859136 00000100:00100000:1.0:1789778135.680331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789778135.680337:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314859136:12345-0@lo:501: 00000100:00100000:1.0:1789778135.680543:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314859136:12345-0@lo:501: Request processed in 205us (272us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789778135.680550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789778135.680578:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314859136:0@lo:501: 10000000:01000000:1.0:1789778135.680598:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789778135.680604:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.680611:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778135.730216:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789778135.730903:0:6739:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789778135.730936:0:6739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859392:0@lo:7: 00000100:00100000:2.0:1789778135.731445:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314859264:0@lo:13: 00000100:00100000:2.0:1789778135.731512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778135.731588:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859264 00000100:00100000:3.0:1789778135.731595:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859264 00000100:00100000:3.0:1789778135.731656:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778135.731666:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876718314859264:12345-0@lo:13: 00002000:00000024:3.0:1789778135.731687:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:3.0:1789778135.734098:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876718314859264:12345-0@lo:13: Request processed in 2424us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778135.734117:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789778135.734155:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789778135.741776:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5856300 x1876718314859264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778135.741804:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314859264:0@lo:13: 00000100:00100000:0.0:1789778135.749061:0:6739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778135.749152:0:6739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778135.749315:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859392 00000100:00100000:2.0:1789778135.749324:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859392 00000100:00100000:2.0:1789778135.749384:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778135.749394:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6739:x1876718314859392:12345-0@lo:7: 00002000:00080000:2.0:1789778135.769025:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789778135.769034:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789778135.769145:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6739:x1876718314859392:12345-0@lo:7: Request processed in 19747us (20087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778135.769156:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789778135.775726:0:6739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5855f80 x1876718314859392/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789778151 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778135.775748:0:6739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859392:0@lo:7: 00000004:00080000:2.0:1789778135.775763:0:6739:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789778135.775808:0:6739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859520:0@lo:5: 00000100:00100000:2.0:1789778135.775865:0:6739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.775914:0:6739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941840 going to sleep for 11 seconds 00000100:00100000:2.0:1789778135.775939:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859520 00000100:00100000:2.0:1789778135.775945:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859520 00000100:00100000:2.0:1789778135.775990:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789778135.775999:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6739:x1876718314859520:12345-0@lo:5: 00002000:00080000:2.0:1789778135.776034:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789778135.776038:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789778135.776347:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6739:x1876718314859520:12345-0@lo:5: Request processed in 348us (480us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789778135.776354:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789778135.776388:0:6739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb581c380 x1876718314859520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789778151 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778135.776399:0:6739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859520:0@lo:5: 00000004:00080000:2.0:1789778135.776408:0:6739:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789778135.776431:0:6739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859648:0@lo:700: 00000100:00100000:2.0:1789778135.776453:0:6739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.776471:0:6739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941840 going to sleep for 11 seconds 00000100:00100000:2.0:1789778135.776488:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859648 00000100:00100000:2.0:1789778135.776492:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859648 00000100:00100000:2.0:1789778135.783464:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778135.783485:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6739:x1876718314859648:12345-0@lo:700: 00000100:00100000:2.0:1789778135.783560:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1876718314859776:0@lo:700: 00000100:00100000:2.0:1789778135.783656:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778135.783687:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789778135.783715:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859776 00000100:00100000:2.0:1789778135.783722:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859776 00000100:00100000:2.0:1789778135.783757:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778135.783764:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1876718314859776:12345-0@lo:700: 00000004:00080000:2.0:1789778135.814119:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789778135.912895:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789778135.918955:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1876718314859776:12345-0@lo:700: Request processed in 135173us (135292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778135.918974:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789778135.919564:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb581ed80 x1876718314859776/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789778151 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778135.919595:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1876718314859776:0@lo:700: 40000000:02000000:2.0:1789778135.919608:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1789778136.062041:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789778136.062060:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789778136.062263:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6739:x1876718314859648:12345-0@lo:700: Request processed in 278782us (285803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778136.062279:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789778136.062652:0:6739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb581ea00 x1876718314859648/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789778151 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778136.062665:0:6739:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789778136.062680:0:6739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859648:0@lo:700: 00000004:02000040:0.0:1789778136.144475:0:6739:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789778136.153761:0:6739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5854000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859904:0@lo:5: 00000100:00100000:0.0:1789778136.153828:0:6739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778136.153891:0:6739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957dab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789778136.154101:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314859904 00000100:00100000:1.0:1789778136.154109:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314859904 00000100:00100000:1.0:1789778136.154160:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778136.154169:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6739:x1876718314859904:12345-0@lo:5: 00002000:00080000:1.0:1789778136.162556:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789778136.162573:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789778136.165702:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6739:x1876718314859904:12345-0@lo:5: Request processed in 11525us (11864us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789778136.165715:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789778136.165772:0:6739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5854000 x1876718314859904/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789778152 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778136.165796:0:6739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5854000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6739:1876718314859904:0@lo:5: 00000004:00080000:1.0:1789778136.165811:0:6739:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789778136.753263:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778137.778085:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778138.802444:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778139.825362:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778140.849188:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789778141.022851:0:7060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789778141.107275:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314860032:0@lo:400: 00000100:00100000:3.0:1789778141.107362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778141.107425:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778141.107431:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314860416:0@lo:400: 00000100:00100000:3.0:1789778141.107475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778141.107502:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314860160:0@lo:400: 00000100:00100000:3.0:1789778141.107528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778141.107580:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314860288:0@lo:400: 00000100:00100000:1.0:1789778141.107603:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860032 00000100:00100000:3.0:1789778141.107607:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778141.107611:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860032 00000100:00100000:3.0:1789778141.107647:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860416 00000100:00100000:1.0:1789778141.107649:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789778141.107650:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860416 00000100:00100000:1.0:1789778141.107657:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3313:x1876718314860032:12345-0@lo:400: 00000100:00100000:3.0:1789778141.107685:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778141.107692:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314860416:12345-0@lo:400: 00000100:00100000:1.0:1789778141.107712:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3313:x1876718314860032:12345-0@lo:400: Request processed in 55us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778141.107720:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789778141.107721:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314860416:12345-0@lo:400: Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778141.107726:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778141.107746:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860160 00000100:00100000:3.0:1789778141.107750:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860160 00000100:00100000:3.0:1789778141.107771:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860288 00000100:00100000:3.0:1789778141.107773:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860288 00000100:00100000:3.0:1789778141.107786:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789778141.107792:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314860160:12345-0@lo:400: 00000100:00100000:3.0:1789778141.107828:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314860160:12345-0@lo:400: Request processed in 37us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778141.107834:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789778141.107845:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789778141.107850:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314860288:12345-0@lo:400: 00000100:00100000:3.0:1789778141.107881:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314860288:12345-0@lo:400: Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778141.107895:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789778141.111862:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789778141.111872:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789778141.111931:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e7100 x1876718314860160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778141.111951:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314860160:0@lo:400: 00010000:00080000:3.0:1789778141.111999:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e6d80 x1876718314860288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778141.112010:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314860288:0@lo:400: 00010000:00080000:0.0:1789778141.115710:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e5c00 x1876718314860416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778141.115731:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314860416:0@lo:400: 00000100:00100000:0.0:1789778141.115745:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314860032:0@lo:400: 00000100:00100000:1.0:1789778141.119451:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778141.119475:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314860544:0@lo:13: 00000100:00100000:1.0:1789778141.119542:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778141.119685:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860544 00000100:00100000:1.0:1789778141.119692:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860544 00000100:00100000:1.0:1789778141.119735:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789778141.119744:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876718314860544:12345-0@lo:13: 00002000:00000024:1.0:1789778141.119773:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778141.119814:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876718314860544:12345-0@lo:13: Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778141.119821:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789778141.119858:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5df3100 x1876718314860544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778141.119877:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314860544:0@lo:13: 00000001:00080000:0.0:1789778141.221947:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789778141.873374:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778142.902449:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778143.922535:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778144.946319:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778145.975224:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778146.226344:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314860672:0@lo:13: 00000100:00100000:1.0:1789778146.226435:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778146.227236:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860672 00000100:00100000:1.0:1789778146.227246:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860672 00000100:00100000:1.0:1789778146.227304:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778146.227314:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314860672:12345-0@lo:13: 00002000:00000024:1.0:1789778146.227352:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778146.227404:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314860672:12345-0@lo:13: Request processed in 92us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778146.227412:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789778146.227494:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778146.228278:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314860800:0@lo:400: 00000100:00100000:1.0:1789778146.228329:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778146.228369:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314860928:0@lo:400: 00000100:00100000:1.0:1789778146.228392:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778146.228408:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778146.228413:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314861056:0@lo:400: 00000100:00100000:1.0:1789778146.228428:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778146.228454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860928 00000100:00100000:1.0:1789778146.228470:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860928 00000100:00100000:0.0:1789778146.228851:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314860800 00000100:00100000:0.0:1789778146.228857:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314860800 00000100:00100000:1.0:1789778146.228892:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861056 00000100:00100000:0.0:1789778146.228895:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789778146.228896:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861056 00000100:00100000:0.0:1789778146.228910:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3311:x1876718314860800:12345-0@lo:400: 00000100:00100000:1.0:1789778146.228923:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789778146.228928:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314860928:12345-0@lo:400: 00000100:00100000:1.0:1789778146.229009:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314860928:12345-0@lo:400: Request processed in 79us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778146.229009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3311:x1876718314860800:12345-0@lo:400: Request processed in 100us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778146.229017:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789778146.229020:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789778146.229032:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789778146.229038:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314861056:12345-0@lo:400: 00000100:00100000:0.0:1789778146.229083:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314860800:0@lo:400: 00000100:00100000:1.0:1789778146.229568:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314861056:12345-0@lo:400: Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778146.229575:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789778146.229597:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789778146.229615:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5df0000 x1876718314861056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778146.229626:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314861056:0@lo:400: 00010000:00080000:1.0:1789778146.229635:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5df1500 x1876718314860928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778146.229642:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314860928:0@lo:400: 00010000:00080000:1.0:1789778146.229666:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5df3100 x1876718314860672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778146.229673:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789778146.229686:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314860672:0@lo:13: 00010000:00010000:2.0:1789778146.996308:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778148.018533:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778149.045141:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778150.070726:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778151.091216:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778151.347961:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314861184:0@lo:400: 00000100:00100000:3.0:1789778151.348036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778151.348120:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778151.348126:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314861312:0@lo:400: 00000100:00100000:3.0:1789778151.348153:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778151.348194:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314861440:0@lo:400: 00000100:00100000:3.0:1789778151.348221:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778151.348240:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789778151.348245:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314861568:0@lo:400: 00000100:00100000:3.0:1789778151.348271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778151.348302:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861184 00000100:00100000:3.0:1789778151.348309:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861184 00000100:00100000:3.0:1789778151.348353:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789778151.348362:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3310:x1876718314861184:12345-0@lo:400: 00000100:00100000:3.0:1789778151.348442:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3310:x1876718314861184:12345-0@lo:400: Request processed in 80us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778151.348449:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789778151.348482:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861312 00000100:00100000:3.0:1789778151.348486:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861312 00000100:00100000:3.0:1789778151.348509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861440 00000100:00100000:3.0:1789778151.348512:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861440 00000100:00100000:3.0:1789778151.348538:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778151.348544:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314861312:12345-0@lo:400: 00000100:00100000:3.0:1789778151.348577:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314861312:12345-0@lo:400: Request processed in 33us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778151.348583:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778151.348596:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789778151.348602:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314861440:12345-0@lo:400: 00000100:00100000:3.0:1789778151.348632:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314861440:12345-0@lo:400: Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778151.348638:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789778151.348658:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861568 00000100:00100000:3.0:1789778151.348662:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861568 00000100:00100000:3.0:1789778151.348686:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789778151.348692:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314861568:12345-0@lo:400: 00000100:00100000:3.0:1789778151.348721:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314861568:12345-0@lo:400: Request processed in 29us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778151.348727:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789778151.348748:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789778151.348753:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789778151.348779:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e4e00 x1876718314861568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778151.348799:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314861568:0@lo:400: 00010000:00080000:3.0:1789778151.348811:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e6a00 x1876718314861440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778151.348819:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314861440:0@lo:400: 00010000:00080000:3.0:1789778151.348847:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e7100 x1876718314861312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778151.348855:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314861312:0@lo:400: 00000100:00100000:3.0:1789778151.348863:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314861184:0@lo:400: 00000100:00100000:3.0:1789778151.354584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314861696:0@lo:13: 00000100:00100000:3.0:1789778151.354656:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778151.355482:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861696 00000100:00100000:1.0:1789778151.355490:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861696 00000100:00100000:1.0:1789778151.355536:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778151.355546:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314861696:12345-0@lo:13: 00002000:00000024:1.0:1789778151.355580:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778151.363951:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314861696:12345-0@lo:13: Request processed in 8397us (9285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778151.363972:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789778151.364211:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb581ed80 x1876718314861696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778151.364238:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314861696:0@lo:13: 00010000:00010000:2.0:1789778152.114088:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778153.147892:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789778154.035850:0:7622:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789778154.035854:0:7622:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789778154.035995:0:7622:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b3ebf7c9000 00000020:01000004:1.0:1789778154.036011:0:7622:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789778154.036024:0:7622:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789778154.036038:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b3e91fe0000) 00000020:00000080:1.0:1789778154.036054:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789778154.058689:0:7622:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789778154.058943:0:7622:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789778154.106058:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789778154.114458:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789778154.114494:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789778154.114546:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789778154.114582:0:7622:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789778154.115239:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789778154.115251:0:7622:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789778154.115264:0:7622:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5a1e1c1157440c07 00000020:01000004:3.0:1789778154.115271:0:7622:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789778154.115297:0:7622:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789778154.115300:0:7622:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789778154.115306:0:7622:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789778154.115341:0:7622:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789778154.115346:0:7622:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789778154.161392:0:7622:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789778154.161437:0:7622:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789778154.161442:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789778154.161443:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789778154.161445:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778154.161446:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778154.161447:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778154.161448:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778154.161449:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778154.161451:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789778154.161452:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789778154.161454:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778154.161455:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789778154.161458:0:7622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789778154.161460:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789778154.161461:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789778154.161463:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778154.161464:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778154.161465:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778154.161466:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778154.161467:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778154.161468:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789778154.161469:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789778154.161470:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778154.161471:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789778154.161496:0:7622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789778154.161513:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314861824:0@lo:253: 00000100:00100000:0.0:1789778154.161584:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.161642:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09780 going to sleep for 11 seconds 00000100:00100000:1.0:1789778154.161819:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861824 00000100:00100000:1.0:1789778154.161827:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861824 00000100:00100000:1.0:1789778154.161878:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789778154.161888:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:7622:x1876718314861824:12345-0@lo:253: 20000000:01000000:1.0:1789778154.161918:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789778154.161922:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789778154.161927:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789778154.161931:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789778154.162883:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778154.163094:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789778154.163107:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789778154.163140:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789778154.163146:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789778154.163169:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789778154.163206:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789778154.163535:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789778154.163551:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:1.0:1789778154.163553:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:1.0:1789778154.163580:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789778154.163586:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789778154.163637:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789778154.163645:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:1.0:1789778154.163678:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789778154.163693:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789778154.163729:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789778154.163791:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789778154.164530:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789778154.164543:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.145@tcp 20000000:01000000:1.0:1789778154.164545:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.145@tcp (null) (null) (null) 00000040:00080000:1.0:1789778154.164572:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789778154.164578:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789778154.164601:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789778154.164607:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.145@tcp (null) (null) 00000040:00080000:1.0:1789778154.164632:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789778154.164640:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789778154.164679:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789778154.164712:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789778154.164725:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789778154.164727:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789778154.164731:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789778154.164741:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789778154.164743:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789778154.164773:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789778154.164775:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00010000:00010000:2.0:1789778154.167894:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1789778154.170337:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789778154.170509:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789778154.170544:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789778154.170920:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789778154.170969:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789778154.171028:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789778154.171042:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789778154.171045:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789778154.171943:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789778154.172003:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789778154.172083:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789778154.172562:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789778154.172678:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789778154.172718:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789778154.172731:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789778154.172734:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789778154.174241:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789778154.174596:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789778154.174657:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789778154.174725:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789778154.174739:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789778154.174742:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789778154.175761:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789778154.175821:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789778154.175873:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789778154.177383:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789778154.177430:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789778154.177509:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789778154.177522:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789778154.177524:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789778154.177530:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789778154.177545:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177558:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ec21f2c00/0x5a1e1c1157440b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177563:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177567:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177571:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177575:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177579:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177607:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177619:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 16 pid: 5840 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778154.177633:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314861952:0@lo:104: 00000100:00100000:1.0:1789778154.177701:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789778154.177762:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177770:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 16 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778154.177778:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862080:0@lo:104: 00010000:00010000:1.0:1789778154.177801:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177808:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 16 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778154.177815:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862208:0@lo:104: 00010000:00010000:1.0:1789778154.177834:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177841:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 16 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778154.177848:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862336:0@lo:104: 00010000:00010000:1.0:1789778154.177866:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ec21f2c00/0x5a1e1c1157440b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.177873:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3ec21f2c00/0x5a1e1c1157440b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 16 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778154.177881:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862464:0@lo:104: 00000100:00100000:1.0:1789778154.177907:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778154.178028:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789778154.178043:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.178061:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.178093:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.178098:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.178106:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314861952 00000100:00100000:2.0:1789778154.178111:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314861952 00000100:00100000:2.0:1789778154.178136:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862080 00000100:00100000:2.0:1789778154.178137:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862080 00000100:00100000:2.0:1789778154.178142:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862208 00000100:00100000:2.0:1789778154.178143:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862208 00000100:00100000:2.0:1789778154.178148:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862336 00000100:00100000:2.0:1789778154.178149:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862336 00000100:00100000:2.0:1789778154.178153:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862464 00000100:00100000:2.0:1789778154.178155:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862464 00000100:00100000:2.0:1789778154.178162:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789778154.178167:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e85d98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:5839:x1876718314861952:12345-0@lo:104: 00010000:00010000:2.0:1789778154.178175:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.178225:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789778154.178229:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e85d98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:5839:x1876718314861952:12345-0@lo:104: Request processed in 62us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.178233:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789778154.178261:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789778154.178264:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:5839:x1876718314862080:12345-0@lo:104: 00010000:00010000:2.0:1789778154.178269:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.178288:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789778154.178291:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:5839:x1876718314862080:12345-0@lo:104: Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.178294:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789778154.178301:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789778154.178304:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:5839:x1876718314862208:12345-0@lo:104: 00010000:00010000:2.0:1789778154.178308:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.178342:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789778154.178347:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:5839:x1876718314862208:12345-0@lo:104: Request processed in 41us (284us total) trans 0 rc 0/0 00010000:00010000:3.0:1789778154.178445:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789778154.178452:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178459:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757200 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:3.0:1789778154.178463:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178471:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789778154.178478:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778154.178483:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789778154.178511:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178517:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789778154.178532:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178537:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157440bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178559:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789778154.178562:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178567:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:3.0:1789778154.178569:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178575:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789778154.178580:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778154.178584:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789778154.178595:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178600:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789778154.178611:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178618:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3200/0x5a1e1c1157440bba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bc1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178630:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778154.178633:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178649:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657600 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:3.0:1789778154.178652:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178658:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789778154.178665:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778154.178670:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789778154.178683:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178689:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789778154.178694:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178700:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ba5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.178709:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778154.178711:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778154.178713:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778154.178733:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314862592:0@lo:103: 00000100:00100000:3.0:1789778154.178762:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.178796:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314862720:0@lo:103: 00000100:00100000:3.0:1789778154.178816:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.178838:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789778154.178843:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314862848:0@lo:103: 00000100:00100000:3.0:1789778154.178860:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.178888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862592 00000100:00100000:3.0:1789778154.178893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862592 00010000:00010000:3.0:1789778154.178911:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 17 pid: 5840 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.178925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862720 00000100:00100000:3.0:1789778154.178928:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862720 00010000:00010000:3.0:1789778154.178936:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 18 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.178945:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862848 00000100:00100000:3.0:1789778154.178947:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862848 00010000:00010000:3.0:1789778154.178955:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 19 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.178973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789778154.178979:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314862592:12345-0@lo:103: 00010000:00010000:3.0:1789778154.178988:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778154.178993:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 19 pid: 5840 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.179003:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 19 pid: 5840 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.179016:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778154.179045:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314862592:12345-0@lo:103: Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.179051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789778154.179091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789778154.179097:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:3312:x1876718314862720:12345-0@lo:103: 00010000:00010000:3.0:1789778154.179105:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778154.179108:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 18 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.179116:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 18 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.179126:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778154.179150:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:3312:x1876718314862720:12345-0@lo:103: Request processed in 54us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.179156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789778154.179168:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778154.179173:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:3312:x1876718314862848:12345-0@lo:103: 00010000:00010000:3.0:1789778154.179180:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778154.179184:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 17 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.179193:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 17 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.179201:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778154.179219:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:3312:x1876718314862848:12345-0@lo:103: Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.179224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778154.179256:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314862592:0@lo:103: 00000100:00100000:3.0:1789778154.179277:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314862848:0@lo:103: 00000100:00100000:3.0:1789778154.179292:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314862720:0@lo:103: 00000100:00100000:2.0:1789778154.179349:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789778154.179438:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789778154.179446:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:5839:x1876718314862336:12345-0@lo:104: 00010000:00010000:2.0:1789778154.179456:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179504:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789778154.179510:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:5839:x1876718314862336:12345-0@lo:104: Request processed in 66us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.179517:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789778154.179530:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778154.179536:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5839:x1876718314862464:12345-0@lo:104: 00010000:00010000:2.0:1789778154.179543:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179570:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789778154.179575:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5839:x1876718314862464:12345-0@lo:104: Request processed in 40us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.179581:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789778154.179598:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778154.179603:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179610:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756a00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778154.179614:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179622:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778154.179628:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778154.179633:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778154.179659:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179666:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778154.179675:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179682:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756a00/0x5a1e1c1157440b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b7b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179693:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778154.179696:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179701:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756400 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778154.179704:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179711:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778154.179716:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778154.179722:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778154.179734:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179739:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778154.179744:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179759:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b51 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.179773:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778154.179774:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778154.179776:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778154.179862:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f3c00/0x5a1e1c1157440bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440bf2 expref: 16 pid: 5840 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778154.179873:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314861952:0@lo:104: 00010000:00010000:0.0:1789778154.179883:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440bc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440bba expref: 15 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778154.179894:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862080:0@lo:104: 00010000:00010000:0.0:1789778154.179903:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440b9e expref: 14 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778154.179912:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862208:0@lo:104: 00000100:00100000:0.0:1789778154.179920:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862336:0@lo:104: 00000100:00100000:0.0:1789778154.179927:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1876718314862464:0@lo:104: 00010000:00010000:0.0:1789778154.179957:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.180013:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314862976:0@lo:103: 00000100:00100000:3.0:1789778154.180042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.180094:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778154.180100:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314863104:0@lo:103: 00000100:00100000:3.0:1789778154.180121:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.180143:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314862976 00000100:00100000:3.0:1789778154.180148:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314862976 00010000:00010000:3.0:1789778154.180163:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 14 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.180178:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314863104 00000100:00100000:3.0:1789778154.180180:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314863104 00010000:00010000:3.0:1789778154.180190:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ec21f2c00/0x5a1e1c1157440b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 15 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.180201:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789778154.180207:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:3310:x1876718314862976:12345-0@lo:103: 00010000:00010000:3.0:1789778154.180216:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778154.180220:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 15 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180229:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 15 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180239:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440b74 expref: 15 pid: 5839 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180248:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778154.180281:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:3310:x1876718314862976:12345-0@lo:103: Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.180287:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789778154.180299:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789778154.180306:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3310:x1876718314863104:12345-0@lo:103: 00010000:00010000:3.0:1789778154.180312:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778154.180331:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ec21f2c00/0x5a1e1c1157440b51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 13 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180340:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ec21f2c00/0x5a1e1c1157440b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 13 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180349:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f2c00/0x5a1e1c1157440b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440b4a expref: 13 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.180487:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778154.180518:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314862976:0@lo:103: 00010000:00010000:3.0:1789778154.180694:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180703:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180718:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180725:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180731:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180737:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180749:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778154.180753:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.180761:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.180873:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.180900:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789778154.180909:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1789778154.181647:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.181657:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.181676:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778154.181729:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3310:x1876718314863104:12345-0@lo:103: Request processed in 1423us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.181737:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778154.181899:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314863104:0@lo:103: 00000100:00100000:1.0:1789778154.222340:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:7622:x1876718314861824:12345-0@lo:253: Request processed in 60443us (60744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778154.222353:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789778154.222516:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314861824:0@lo:253: 10000000:01000000:0.0:1789778154.222531:0:7622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789778154.222534:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789778154.222536:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789778154.222537:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778154.222539:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789778154.222540:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778154.222542:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778154.222543:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778154.222545:0:7622:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789778154.222546:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778154.222548:0:7622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789778154.222568:0:7622:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3ebf7c9000 from lustre-OST0001 10000000:01000000:0.0:1789778154.222594:0:7622:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789778154.222597:0:7622:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789778154.222605:0:7622:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3e85d019b8 local copy 10000000:01000000:0.0:1789778154.222610:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789778154.222707:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.222718:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.222745:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778154.222763:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863232:0@lo:101: 00000100:00100000:0.0:1789778154.222798:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.222878:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09600 going to sleep for 11 seconds 00000100:00100000:3.0:1789778154.222914:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314863232 00000100:00100000:3.0:1789778154.222921:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314863232 00000100:00100000:3.0:1789778154.222992:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789778154.223001:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:7622:x1876718314863232:12345-0@lo:101: 00010000:00010000:3.0:1789778154.223015:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778154.223029:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440c1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440c15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.223051:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440c15 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.223061:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c15 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.223098:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150ea00, rc 0) 00000100:00100000:3.0:1789778154.223138:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863232:12345-0@lo:101: Request processed in 139us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.223144:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789778154.223210:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863232:0@lo:101: 00010000:00010000:2.0:1789778154.223222:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.223231:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778154.223332:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863360:0@lo:501: 00000100:00100000:2.0:1789778154.223430:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.223557:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0117000 going to sleep for 11 seconds 00000100:00100000:0.0:1789778154.223692:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314863360 00000100:00100000:0.0:1789778154.223698:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314863360 00000100:00100000:0.0:1789778154.223720:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789778154.223727:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863360:12345-0@lo:501: 00000100:00100000:0.0:1789778154.223945:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863360:12345-0@lo:501: Request processed in 217us (514us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789778154.223952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789778154.224025:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863360:0@lo:501: 10000000:01000000:2.0:1789778154.224038:0:7622:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789778154.224089:0:7622:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789778154.224095:0:7622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.224115:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.224123:0:7622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.224144:0:7622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789778154.224164:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3ebf7c9000 10000000:01000000:2.0:1789778154.224168:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789778154.224172:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789778154.224175:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778154.224179:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789778154.224181:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789778154.224199:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.224207:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.224215:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778154.224227:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863488:0@lo:101: 00000100:00100000:2.0:1789778154.224254:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.224266:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0117480 going to sleep for 11 seconds 00010000:00010000:0.0:1789778154.224353:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778154.224369:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224377:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:0.0:1789778154.224381:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224389:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789778154.224396:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778154.224402:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789778154.224428:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224433:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789778154.224451:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224458:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757800/0x5a1e1c1157440c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5a1e1c1157440c1c expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224468:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778154.224470:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778154.224471:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778154.224481:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314863616:0@lo:103: 00000100:00100000:0.0:1789778154.224508:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.224547:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314863616 00000100:00100000:0.0:1789778154.224550:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314863616 00000100:00100000:0.0:1789778154.224582:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789778154.224589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3312:x1876718314863616:12345-0@lo:103: 00010000:00010000:0.0:1789778154.224599:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778154.224612:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440c15 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224635:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778154.224663:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:3312:x1876718314863616:12345-0@lo:103: Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778154.224669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789778154.224696:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314863616:0@lo:103: 00000100:00100000:0.0:1789778154.224715:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314863488 00000100:00100000:0.0:1789778154.224725:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314863488 00000100:00100000:0.0:1789778154.224741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789778154.224747:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+11:7622:x1876718314863488:12345-0@lo:101: 00010000:00010000:0.0:1789778154.224755:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778154.224765:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440c23 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224780:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224789:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.224795:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757c00, rc 0) 00000100:00100000:0.0:1789778154.224821:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863488:12345-0@lo:101: Request processed in 74us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778154.224826:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789778154.225107:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863488:0@lo:101: 00010000:00010000:2.0:1789778154.225118:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.225136:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778154.225203:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863744:0@lo:501: 00000100:00100000:2.0:1789778154.225227:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.225251:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0117480 going to sleep for 11 seconds 00000100:00100000:3.0:1789778154.225524:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314863744 00000100:00100000:3.0:1789778154.225530:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314863744 00000100:00100000:3.0:1789778154.225566:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789778154.225574:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863744:12345-0@lo:501: 00000100:00100000:3.0:1789778154.225924:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863744:12345-0@lo:501: Request processed in 350us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.225931:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789778154.226053:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863744:0@lo:501: 00000100:00100000:3.0:1789778154.226263:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863872:0@lo:503: 00000100:00100000:3.0:1789778154.226301:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.226440:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904b4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778154.226478:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314863872 00000100:00100000:2.0:1789778154.226483:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314863872 00000100:00100000:2.0:1789778154.226553:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789778154.226561:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863872:12345-0@lo:503: 00000100:00100000:2.0:1789778154.226782:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314863872:12345-0@lo:503: Request processed in 221us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.226788:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789778154.226855:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314863872:0@lo:503: 00000040:00080000:0.0:1789778154.227147:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789778154.227203:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864000:0@lo:502: 00000100:00100000:0.0:1789778154.227242:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.227496:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d090c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778154.227567:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864000 00000100:00100000:3.0:1789778154.227573:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864000 00000100:00100000:3.0:1789778154.227599:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789778154.227605:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314864000:12345-0@lo:502: 00000100:00100000:3.0:1789778154.227757:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314864000:12345-0@lo:502: Request processed in 151us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.227764:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789778154.227899:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864000:0@lo:502: 00000040:00080000:0.0:1789778154.228197:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789778154.228244:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789778154.228273:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789778154.228329:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789778154.228435:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789778154.228484:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789778154.228510:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864128:0@lo:502: 00000100:00100000:0.0:1789778154.228554:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.228576:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d090c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778154.228647:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864128 00000100:00100000:3.0:1789778154.228653:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864128 00000100:00100000:3.0:1789778154.228679:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789778154.228686:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314864128:12345-0@lo:502: 00000100:00100000:3.0:1789778154.228827:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314864128:12345-0@lo:502: Request processed in 140us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.228839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789778154.228970:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864128:0@lo:502: 00000040:00080000:0.0:1789778154.229057:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789778154.229097:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789778154.229891:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789778154.229900:0:7632:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789778154.229906:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778154.229909:0:7632:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789778154.229915:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778154.229929:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b3eb9770000) 00000020:00000080:0.0:1789778154.229949:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789778154.229955:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789778154.230031:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ebf7c9000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789778154.230039:0:7632:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789778154.230046:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5a1e1c1157440c38 00010000:00010000:1.0:1789778154.242128:0:7632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789778154.243796:0:7632:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789778154.247575:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789778154.247962:0:7632:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789778154.255513:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789778154.256305:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789778154.257896:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789778154.257906:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778154.257912:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778154.257914:0:7632:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789778154.257917:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778154.257920:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778154.257921:0:7632:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789778154.257924:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789778154.257925:0:7632:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789778154.257971:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778154.257974:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778154.257975:0:7632:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789778154.257978:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789778154.258158:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789778154.258182:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789778154.258204:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.258216:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778154.258224:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ebf7c9000 from 1 10000000:01000000:3.0:1789778154.258227:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789778154.258260:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.258268:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.258278:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.258299:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864256:0@lo:101: 00000100:00100000:3.0:1789778154.258438:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.258487:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904b4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778154.258688:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864256 00000100:00100000:1.0:1789778154.258696:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864256 00000100:00100000:1.0:1789778154.258741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789778154.258750:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:7622:x1876718314864256:12345-0@lo:101: 00010000:00010000:1.0:1789778154.258763:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778154.258777:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440c3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.258816:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.258825:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.258833:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3000, rc 0) 00000100:00100000:1.0:1789778154.258879:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864256:12345-0@lo:101: Request processed in 130us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778154.258885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789778154.258957:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864256:0@lo:101: 00010000:00010000:0.0:1789778154.258970:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778154.258979:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778154.259057:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864384:0@lo:501: 00000100:00100000:0.0:1789778154.259110:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.259127:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778154.259184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864384 00000100:00100000:1.0:1789778154.259188:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864384 00000100:00100000:1.0:1789778154.259795:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789778154.259804:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864384:12345-0@lo:501: 00000100:00100000:1.0:1789778154.260045:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864384:12345-0@lo:501: Request processed in 242us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778154.260052:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789778154.263423:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864384:0@lo:501: 00000100:00100000:0.0:1789778154.263607:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864512:0@lo:503: 00000100:00100000:0.0:1789778154.263690:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.263730:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09240 going to sleep for 11 seconds 00000100:00100000:0.0:1789778154.263748:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864512 00000100:00100000:0.0:1789778154.263754:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864512 00000100:00100000:0.0:1789778154.263794:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789778154.263804:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864512:12345-0@lo:503: 00000100:00100000:0.0:1789778154.264181:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864512:12345-0@lo:503: Request processed in 377us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778154.264190:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789778154.264237:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864512:0@lo:503: 00000040:00080000:0.0:1789778154.264757:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789778154.264825:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864640:0@lo:502: 00000100:00100000:0.0:1789778154.264859:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.264877:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789778154.264892:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864640 00000100:00100000:0.0:1789778154.264896:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864640 00000100:00100000:0.0:1789778154.264914:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789778154.264920:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864640:12345-0@lo:502: 00000100:00100000:0.0:1789778154.265050:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864640:12345-0@lo:502: Request processed in 130us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778154.265057:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789778154.265115:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864640:0@lo:502: 00000040:00080000:0.0:1789778154.265576:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789778154.266560:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789778154.266604:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864768:0@lo:502: 00000100:00100000:0.0:1789778154.266727:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778154.266759:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd4240 going to sleep for 11 seconds 00000100:00100000:3.0:1789778154.267301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864768 00000100:00100000:3.0:1789778154.267309:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864768 00000100:00100000:3.0:1789778154.267374:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789778154.267385:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864768:12345-0@lo:502: 00000100:00100000:3.0:1789778154.267583:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864768:12345-0@lo:502: Request processed in 199us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.267600:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789778154.267860:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864768:0@lo:502: 00000040:00080000:0.0:1789778154.267982:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789778154.267998:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789778154.270034:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778154.270050:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778154.270053:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789778154.270059:0:7636:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ebf7c9000 00000020:00000080:0.0:1789778154.270084:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789778154.270106:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778154.270109:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778154.270111:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789778154.270113:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789778154.270291:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789778154.270313:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778154.270345:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.270457:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778154.270563:0:7622:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789778154.270567:0:7622:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3ebf7c9000 10000000:01000000:3.0:1789778154.270570:0:7622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3ebf7c9000 10000000:01000000:3.0:1789778154.270574:0:7622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789778154.270580:0:7622:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3ebf7c9000 from 1 10000000:01000000:3.0:1789778154.270583:0:7622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789778154.270682:0:7622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.270691:0:7622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.270701:0:7622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.270723:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864896:0@lo:101: 00000100:00100000:3.0:1789778154.270798:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.270845:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904b4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789778154.271429:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314864896 00000100:00100000:1.0:1789778154.271439:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314864896 00000100:00100000:1.0:1789778154.271547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789778154.271557:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314864896:12345-0@lo:101: 00010000:00010000:1.0:1789778154.271570:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778154.271586:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440c4d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.271676:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.271703:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778154.271711:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3e00, rc 0) 00000100:00100000:1.0:1789778154.271767:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314864896:12345-0@lo:101: Request processed in 211us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778154.271774:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789778154.273543:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314864896:0@lo:101: 00010000:00010000:2.0:1789778154.273569:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.273581:0:7622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778154.274149:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865024:0@lo:501: 00000100:00100000:2.0:1789778154.274207:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.274247:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea01176c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778154.274448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865024 00000100:00100000:1.0:1789778154.274455:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865024 00000100:00100000:1.0:1789778154.274568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789778154.274578:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865024:12345-0@lo:501: 00000100:00100000:1.0:1789778154.275024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865024:12345-0@lo:501: Request processed in 446us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778154.275032:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789778154.275244:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865024:0@lo:501: 00000100:00100000:2.0:1789778154.275287:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865152:0@lo:503: 00000100:00100000:2.0:1789778154.275337:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.275447:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865152 00000100:00100000:3.0:1789778154.275452:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865152 00000100:00100000:3.0:1789778154.275557:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789778154.275566:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865152:12345-0@lo:503: 00000100:00100000:3.0:1789778154.275769:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865152:12345-0@lo:503: Request processed in 205us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.275777:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789778154.276429:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea01176c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778154.276451:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865152:0@lo:503: 00000040:00080000:2.0:1789778154.277794:0:7622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789778154.277875:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865280:0@lo:502: 00000100:00100000:2.0:1789778154.277939:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.277978:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea01176c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778154.278124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865280 00000100:00100000:1.0:1789778154.278131:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865280 00000100:00100000:1.0:1789778154.278169:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789778154.278180:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865280:12345-0@lo:502: 00000100:00100000:1.0:1789778154.278908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865280:12345-0@lo:502: Request processed in 727us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778154.278916:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789778154.279018:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865280:0@lo:502: 00000040:00080000:2.0:1789778154.279598:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789778154.279771:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789778154.279806:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789778154.279867:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789778154.279906:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789778154.279953:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789778154.279991:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789778154.280024:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789778154.280740:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789778154.280797:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789778154.280830:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789778154.280879:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789778154.280917:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789778154.280952:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789778154.281000:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789778154.281053:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789778154.284354:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789778154.285993:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789778154.286013:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789778154.286029:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789778154.286101:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789778154.286140:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789778154.286167:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789778154.286211:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789778154.286233:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789778154.286261:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789778154.286288:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789778154.286305:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789778154.286340:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789778154.286394:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789778154.286430:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789778154.286487:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789778154.286523:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789778154.286583:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789778154.288975:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789778154.298350:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789778154.298557:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789778154.298728:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865408:0@lo:502: 00000100:00100000:3.0:1789778154.298817:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.298862:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778154.299818:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865408 00000100:00100000:1.0:1789778154.299830:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865408 00000100:00100000:1.0:1789778154.299890:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789778154.299901:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865408:12345-0@lo:502: 00000100:00100000:1.0:1789778154.300227:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314865408:12345-0@lo:502: Request processed in 327us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778154.300242:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789778154.300818:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314865408:0@lo:502: 00000040:00080000:2.0:1789778154.300940:0:7622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789778154.300954:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789778154.305332:0:7637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789778154.305351:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b3e91fe3370) 00000020:00000080:1.0:1789778154.305384:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789778154.305456:0:7637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ebf7c9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789778154.305460:0:7637:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3ebf7c9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789778154.305463:0:7637:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ebf7c9000 3 00010000:00080000:1.0:1789778154.305603:0:7637:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3ec1643000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1789778154.312268:0:7637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789778154.312465:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789778154.312501:0:7637:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789778154.312514:0:7637:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5a1e1c1157440c62 00000100:00080000:1.0:1789778154.312523:0:7637:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789778154.312529:0:7637:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b3ec1643000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1789778154.312562:0:7637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3eb5df3b80 x1876718314865536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789778154.312589:0:7637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789778154.313585:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314865536:0@lo:38: 00000100:00100000:2.0:1789778154.313667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.313731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865536 00000100:00100000:2.0:1789778154.313738:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865536 00000100:00100000:2.0:1789778154.313776:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789778154.313783:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876718314865536:12345-0@lo:38: 00010000:00080000:2.0:1789778154.313820:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1789778154.313853:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5a1e1c1157440c69 00000004:00100000:2.0:1789778154.313872:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789778154.313906:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9b3e88cf7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778154.313956:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876718314865536:12345-0@lo:38: Request processed in 171us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.313976:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789778154.314014:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb5df3b80 x1876718314865536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789778164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778154.314023:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789778154.314041:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789778154.314048:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789778154.314052:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789778154.314060:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1643000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789778154.314097:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314865536:0@lo:38: 00000100:00100000:2.0:1789778154.314351:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314865664:0@lo:400: 00000100:00100000:2.0:1789778154.314510:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.314762:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314865792:0@lo:400: 00000100:00100000:2.0:1789778154.314788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.314807:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778154.314812:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314865920:0@lo:400: 00000100:00100000:2.0:1789778154.314837:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.314866:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865920 00000100:00100000:2.0:1789778154.314871:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865920 00000100:00100000:2.0:1789778154.314916:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789778154.314926:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314865920:12345-0@lo:400: 00000100:00100000:2.0:1789778154.314966:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314865920:12345-0@lo:400: Request processed in 42us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.314972:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789778154.314988:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789778154.315010:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e4a80 x1876718314865920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778154.315030:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314865920:0@lo:400: 00000100:00100000:2.0:1789778154.315050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865664 00000100:00100000:2.0:1789778154.315054:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865664 00000100:00100000:2.0:1789778154.315100:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314865792 00000100:00100000:2.0:1789778154.315104:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314865792 00000100:00100000:2.0:1789778154.315125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778154.315131:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314865664:12345-0@lo:400: 00000100:00100000:2.0:1789778154.315164:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314865664:12345-0@lo:400: Request processed in 33us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.315171:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778154.315182:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789778154.315187:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314865792:12345-0@lo:400: 00000100:00100000:2.0:1789778154.315217:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314865792:12345-0@lo:400: Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.315223:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789778154.315236:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789778154.315250:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e7b80 x1876718314865664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778154.315260:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314865664:0@lo:400: 00010000:00080000:2.0:1789778154.315281:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e7100 x1876718314865792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778154.315290:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314865792:0@lo:400: 00000100:00100000:3.0:1789778154.321708:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1876718314866048:0@lo:901: 00000040:00080000:0.0:1789778154.321739:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789778154.321780:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.321834:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866048 00000100:00100000:3.0:1789778154.321841:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866048 00000100:00100000:3.0:1789778154.321897:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778154.321905:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1876718314866048:12345-0@lo:901: 00000020:01000000:2.0:1789778154.321921:0:7622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789778154.321946:0:7622:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789778154.321959:0:7622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.321975:0:7622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789778154.322019:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789778154.322021:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778154.322023:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778154.322024:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778154.322025:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778154.322026:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778154.322028:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778154.322029:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789778154.322030:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789778154.322032:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778154.322033:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789778154.322037:0:7622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789778154.322039:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789778154.322041:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778154.322042:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778154.322043:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778154.322044:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778154.322045:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778154.322046:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778154.322047:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789778154.322048:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789778154.322049:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778154.322050:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789778154.322091:0:7622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789778154.322101:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314866176:0@lo:253: 00000100:00100000:2.0:1789778154.322138:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778154.322163:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0117c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778154.322188:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866176 00000100:00100000:2.0:1789778154.322192:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866176 00000100:00100000:2.0:1789778154.322218:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789778154.322225:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7622:x1876718314866176:12345-0@lo:253: 20000000:01000000:2.0:1789778154.322257:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1789778154.322267:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1876718314866048:12345-0@lo:901: Request processed in 363us (487us total) trans 0 rc 0/0 20000000:01000000:2.0:1789778154.322271:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789778154.322275:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778154.322293:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957da3c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789778154.322326:0:7638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3e987e7100 x1876718314866048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789778170 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778154.322339:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1876718314866048:0@lo:901: 00000100:00080000:0.0:1789778154.322939:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1789778154.389994:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789778154.390088:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789778154.397461:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789778154.397996:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789778154.398029:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.398101:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.398110:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.398153:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.398168:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 14 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.398182:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876718314866304:0@lo:104: 00000100:00100000:3.0:1789778154.398241:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.398292:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778154.398455:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866304 00000100:00100000:2.0:1789778154.398463:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866304 00000100:00100000:2.0:1789778154.398530:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789778154.398540:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5861:x1876718314866304:12345-0@lo:104: 00010000:00010000:2.0:1789778154.398555:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.398604:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789778154.398610:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:5861:x1876718314866304:12345-0@lo:104: Request processed in 72us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.398617:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789778154.398637:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778154.398643:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.398650:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2200 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778154.398654:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.398662:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778154.398669:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778154.398675:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778154.398716:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.398723:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778154.398743:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.398750:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2200/0x5a1e1c1157440bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440bb3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778154.398768:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778154.398771:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778154.398772:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778154.398780:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778154.398791:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314866432:0@lo:103: 00000100:00100000:2.0:1789778154.398821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778154.399861:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866432 00000100:00100000:3.0:1789778154.399870:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866432 00010000:00010000:3.0:1789778154.399899:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 15 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.399932:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789778154.399940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:3313:x1876718314866432:12345-0@lo:103: 00010000:00010000:3.0:1789778154.399953:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778154.399958:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 15 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.399969:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 15 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400001:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400008:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789778154.400034:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003767843s 00010000:00010000:3.0:1789778154.400039:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400046:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400054:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400061:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400094:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150fc00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778154.400098:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400105:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400114:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400124:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778154.400169:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:3313:x1876718314866432:12345-0@lo:103: Request processed in 229us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778154.400180:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789778154.400237:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314866432:0@lo:103: 00010000:00010000:3.0:1789778154.400438:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f2800/0x5a1e1c1157440bb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440bac expref: 14 pid: 5841 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778154.400451:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876718314866304:0@lo:104: 00010000:00010000:3.0:1789778154.400465:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400534:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400542:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778154.400548:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440c70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778154.426968:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:7622:x1876718314866176:12345-0@lo:253: Request processed in 104734us (104820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778154.426983:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789778154.427109:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7622:1876718314866176:0@lo:253: 10000000:01000000:0.0:1789778154.427124:0:7622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789778154.427128:0:7622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789778154.427129:0:7622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789778154.427130:0:7622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778154.427132:0:7622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778154.427133:0:7622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778154.427134:0:7622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778154.427136:0:7622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778154.427137:0:7622:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789778154.427139:0:7622:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789778154.427140:0:7622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778154.427142:0:7622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789778154.427159:0:7622:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789778154.437158:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789778154.437387:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789778154.437584:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789778154.437774:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789778154.437959:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789778154.438226:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789778154.454966:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789778154.811716:0:7622:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789778154.811724:0:7622:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789778154.811758:0:7622:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789778154.811815:0:7622:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789778154.811829:0:7622:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789778154.811858:0:7622:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789778155.185246:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778156.210596:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778156.466723:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778156.466748:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314866560:0@lo:13: 00000100:00100000:1.0:1789778156.466814:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778156.466888:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866560 00000100:00100000:1.0:1789778156.466896:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866560 00000100:00100000:1.0:1789778156.466969:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778156.466978:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314866560:12345-0@lo:13: 00002000:00000024:1.0:1789778156.467028:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778156.467093:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314866560:12345-0@lo:13: Request processed in 116us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778156.467118:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789778156.467140:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789778156.467171:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df1f80 x1876718314866560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778156.467190:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314866560:0@lo:13: 00010000:00010000:0.0:1789778157.238107:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778158.257285:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778159.284285:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778159.539029:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314866816:0@lo:400: 00000100:00100000:1.0:1789778159.540023:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314866688:0@lo:400: 00000100:00100000:3.0:1789778159.540950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778159.541055:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314867072:0@lo:400: 00000100:00100000:3.0:1789778159.541127:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778159.541159:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778159.541167:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314866944:0@lo:400: 00000100:00100000:1.0:1789778159.541432:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778159.543359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778159.543426:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866816 00000100:00100000:3.0:1789778159.543439:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866816 00000100:00100000:1.0:1789778159.543587:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866688 00000100:00100000:1.0:1789778159.543592:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866688 00000100:00100000:1.0:1789778159.544327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789778159.544343:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3310:x1876718314866688:12345-0@lo:400: 00000100:00100000:1.0:1789778159.544442:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3310:x1876718314866688:12345-0@lo:400: Request processed in 103us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778159.544618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314866944 00000100:00100000:3.0:1789778159.544623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314866944 00000100:00100000:3.0:1789778159.544983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789778159.544991:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314866816:12345-0@lo:400: 00000100:00100000:3.0:1789778159.545049:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314866816:12345-0@lo:400: Request processed in 58us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778159.545056:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789778159.545094:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789778159.545101:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314866944:12345-0@lo:400: 00000100:00100000:1.0:1789778159.545392:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789778159.545786:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778159.545995:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314866944:12345-0@lo:400: Request processed in 893us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778159.546004:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789778159.546034:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867072 00000100:00100000:3.0:1789778159.546041:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867072 00000100:00100000:3.0:1789778159.546109:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789778159.546118:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314867072:12345-0@lo:400: 00000100:00100000:3.0:1789778159.546157:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314867072:12345-0@lo:400: Request processed in 40us (5030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778159.546164:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789778159.548607:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789778159.548810:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e987e5880 x1876718314866816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778159.548834:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314866816:0@lo:400: 00000100:00100000:1.0:1789778159.549020:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314866688:0@lo:400: 00000100:00100000:1.0:1789778159.549037:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314867200:0@lo:400: 00000100:00100000:1.0:1789778159.549159:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789778159.549731:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e987e6680 x1876718314866944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778159.549744:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314866944:0@lo:400: 00010000:00080000:3.0:1789778159.549767:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e987e4000 x1876718314867072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778159.549776:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314867072:0@lo:400: 00000100:00100000:1.0:1789778159.550814:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867200 00000100:00100000:1.0:1789778159.550827:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867200 00000100:00080000:0.0:1789778159.551029:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778159.551588:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789778159.551603:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314867200:12345-0@lo:400: 00000100:00100000:1.0:1789778159.552098:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314867200:12345-0@lo:400: Request processed in 466us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778159.552115:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789778159.553427:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e987e6a00 x1876718314867200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778159.553448:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314867200:0@lo:400: 00010000:00010000:2.0:1789778160.307577:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778161.352261:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778161.585278:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314867328:0@lo:13: 00000100:00100000:2.0:1789778161.585350:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.585458:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867328 00000100:00100000:1.0:1789778161.585466:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867328 00000100:00100000:1.0:1789778161.585530:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789778161.585540:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314867328:12345-0@lo:13: 00002000:00000024:1.0:1789778161.585575:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778161.585621:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314867328:12345-0@lo:13: Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.585629:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789778161.585670:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df3b80 x1876718314867328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778161.585688:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314867328:0@lo:13: 00000100:00080000:2.0:1789778161.585799:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789778161.586220:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789778161.586224:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3ec0d89800 from 30 10000000:01000000:1.0:1789778161.586228:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789778161.586262:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.586272:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.586282:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.586299:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314867456:0@lo:101: 00000100:00100000:1.0:1789778161.586333:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.586364:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eba73a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778161.586414:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867456 00000100:00100000:2.0:1789778161.586419:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867456 00000100:00100000:2.0:1789778161.586456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789778161.586463:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314867456:12345-0@lo:101: 00010000:00010000:2.0:1789778161.586474:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778161.586486:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440c77 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778161.586516:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778161.586527:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778161.586536:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657c00, rc 0) 00000100:00100000:2.0:1789778161.586575:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314867456:12345-0@lo:101: Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778161.586581:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789778161.586647:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314867456:0@lo:101: 00010000:00010000:0.0:1789778161.586661:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.586671:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778161.586719:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314867584:0@lo:501: 00000100:00100000:0.0:1789778161.586746:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.586769:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.587248:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867584 00000100:00100000:1.0:1789778161.587253:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867584 00000100:00100000:1.0:1789778161.587287:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789778161.587295:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314867584:12345-0@lo:501: 00000100:00100000:1.0:1789778161.587660:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314867584:12345-0@lo:501: Request processed in 364us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.587667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789778161.587706:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314867584:0@lo:501: 00000100:00100000:1.0:1789778161.587742:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314867712:0@lo:503: 00000100:00100000:1.0:1789778161.587784:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.587806:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eba73a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.587817:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867712 00000100:00100000:1.0:1789778161.587821:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867712 00000100:00100000:1.0:1789778161.587843:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789778161.587849:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314867712:12345-0@lo:503: 00000100:00100000:1.0:1789778161.588159:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314867712:12345-0@lo:503: Request processed in 309us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.588166:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789778161.588215:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314867712:0@lo:503: 00000100:00100000:1.0:1789778161.588387:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7911:1876718314867840:0@lo:502: 00000100:00100000:1.0:1789778161.588425:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.588445:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867840 00000100:00100000:1.0:1789778161.588448:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867840 00000100:00100000:1.0:1789778161.588466:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789778161.588471:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7911:x1876718314867840:12345-0@lo:502: 00000100:00100000:1.0:1789778161.588663:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7911:x1876718314867840:12345-0@lo:502: Request processed in 190us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.588675:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789778161.588708:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eba73a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.588721:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7911:1876718314867840:0@lo:502: 00000100:00100000:1.0:1789778161.588758:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7911:1876718314867968:0@lo:502: 00000100:00100000:1.0:1789778161.588789:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.588806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314867968 00000100:00100000:1.0:1789778161.588810:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314867968 00000100:00100000:1.0:1789778161.588827:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789778161.588832:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7911:x1876718314867968:12345-0@lo:502: 00000100:00100000:1.0:1789778161.588947:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:7911:x1876718314867968:12345-0@lo:502: Request processed in 114us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.588953:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789778161.588978:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eba73a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.588991:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7911:1876718314867968:0@lo:502: 00000040:00080000:1.0:1789778161.589009:0:7911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789778161.589051:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789778161.589094:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789778161.589105:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.589115:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778161.589125:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789778161.589128:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789778161.589131:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789778161.589153:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.589166:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.589176:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.589202:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868096:0@lo:101: 00000100:00100000:1.0:1789778161.589228:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.589245:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.589258:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868096 00000100:00100000:1.0:1789778161.589261:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868096 00000100:00100000:1.0:1789778161.589278:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789778161.589285:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314868096:12345-0@lo:101: 00010000:00010000:1.0:1789778161.589294:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778161.589305:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440c85 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.589325:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.589335:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.589343:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2200, rc 0) 00000100:00100000:1.0:1789778161.589373:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314868096:12345-0@lo:101: Request processed in 89us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.589379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789778161.589409:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868096:0@lo:101: 00010000:00010000:1.0:1789778161.589428:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.589437:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.589475:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868224:0@lo:501: 00000100:00100000:1.0:1789778161.589497:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.589512:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.589524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868224 00000100:00100000:1.0:1789778161.589527:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868224 00000100:00100000:1.0:1789778161.589545:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789778161.589550:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314868224:12345-0@lo:501: 00000100:00100000:1.0:1789778161.589735:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314868224:12345-0@lo:501: Request processed in 183us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.589742:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789778161.589770:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868224:0@lo:501: 00000100:00100000:1.0:1789778161.589795:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868352:0@lo:503: 00000100:00100000:1.0:1789778161.589828:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.589841:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.589851:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868352 00000100:00100000:1.0:1789778161.589855:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868352 00000100:00100000:1.0:1789778161.589870:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789778161.589875:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314868352:12345-0@lo:503: 00000100:00100000:1.0:1789778161.590161:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314868352:12345-0@lo:503: Request processed in 285us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.590168:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789778161.604616:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868352:0@lo:503: 00000100:00100000:0.0:1789778161.614311:0:7914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7914:1876718314868480:0@lo:502: 00000100:00100000:0.0:1789778161.614389:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.614427:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868480 00000100:00100000:0.0:1789778161.614433:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868480 00000100:00100000:0.0:1789778161.614481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789778161.614490:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:7914:x1876718314868480:12345-0@lo:502: 00000100:00100000:0.0:1789778161.614755:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:7914:x1876718314868480:12345-0@lo:502: Request processed in 265us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.614769:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789778161.614818:0:7914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789778161.614839:0:7914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7914:1876718314868480:0@lo:502: 00000020:01000000:0.0:1789778161.614866:0:7914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778161.614875:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778161.614877:0:7914:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789778161.614882:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789778161.614884:0:7914:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789778161.614899:0:7914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7914:1876718314868608:0@lo:502: 00000100:00100000:0.0:1789778161.614931:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.614945:0:7914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.615302:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868608 00000100:00100000:1.0:1789778161.615307:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868608 00000100:00100000:1.0:1789778161.615339:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789778161.615347:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:7914:x1876718314868608:12345-0@lo:502: 00000100:00100000:1.0:1789778161.615487:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:7914:x1876718314868608:12345-0@lo:502: Request processed in 140us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.615494:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789778161.615591:0:7914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7914:1876718314868608:0@lo:502: 00000020:01000000:0.0:1789778161.615614:0:7914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778161.615619:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778161.615620:0:7914:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789778161.615624:0:7914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789778161.618981:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789778161.619028:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789778161.619042:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.619052:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778161.625086:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789778161.625094:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3eabbad800 from 30 10000000:01000000:0.0:1789778161.625101:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789778161.625151:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.625163:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.625175:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778161.625210:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868736:0@lo:101: 00000100:00100000:0.0:1789778161.625650:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.625697:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.625748:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868736 00000100:00100000:1.0:1789778161.625756:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868736 00000100:00100000:1.0:1789778161.625811:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789778161.625821:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314868736:12345-0@lo:101: 00010000:00010000:1.0:1789778161.625835:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778161.625849:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440c93 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.625874:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.625885:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.625906:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3200, rc 0) 00000100:00100000:1.0:1789778161.625948:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314868736:12345-0@lo:101: Request processed in 128us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.625955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789778161.626862:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868736:0@lo:101: 00010000:00010000:0.0:1789778161.626882:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.626893:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778161.626958:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868864:0@lo:501: 00000100:00100000:0.0:1789778161.626993:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778161.627130:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868864 00000100:00100000:3.0:1789778161.627135:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868864 00000100:00100000:3.0:1789778161.627169:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789778161.627178:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314868864:12345-0@lo:501: 00000100:00100000:3.0:1789778161.627455:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314868864:12345-0@lo:501: Request processed in 277us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778161.627463:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789778161.627710:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789778161.627725:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868864:0@lo:501: 00000100:00100000:0.0:1789778161.627754:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868992:0@lo:503: 00000100:00100000:0.0:1789778161.627793:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.627815:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789778161.627830:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314868992 00000100:00100000:0.0:1789778161.627833:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314868992 00000100:00100000:0.0:1789778161.627893:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789778161.627901:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314868992:12345-0@lo:503: 00000100:00100000:0.0:1789778161.628087:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314868992:12345-0@lo:503: Request processed in 186us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.628094:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789778161.636614:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314868992:0@lo:503: 00000100:00100000:0.0:1789778161.638763:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7915:1876718314869120:0@lo:502: 00000100:00100000:0.0:1789778161.638849:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.638894:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.638940:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314869120 00000100:00100000:1.0:1789778161.638947:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314869120 00000100:00100000:1.0:1789778161.638995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789778161.639006:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:7915:x1876718314869120:12345-0@lo:502: 00000100:00100000:1.0:1789778161.639311:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:7915:x1876718314869120:12345-0@lo:502: Request processed in 306us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.639318:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789778161.639640:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7915:1876718314869120:0@lo:502: 00000100:00100000:0.0:1789778161.639688:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7915:1876718314869248:0@lo:502: 00000100:00100000:0.0:1789778161.639719:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.639736:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90dc29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778161.639787:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314869248 00000100:00100000:3.0:1789778161.639792:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314869248 00000100:00100000:3.0:1789778161.639823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789778161.639830:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:7915:x1876718314869248:12345-0@lo:502: 00000100:00100000:3.0:1789778161.641273:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:7915:x1876718314869248:12345-0@lo:502: Request processed in 1424us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778161.641284:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789778161.654203:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7915:1876718314869248:0@lo:502: 00000040:00080000:0.0:1789778161.654257:0:7915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789778161.654508:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789778161.654528:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789778161.654540:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.654552:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778161.654562:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789778161.654565:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3eabbad800 from 5 10000000:01000000:1.0:1789778161.654567:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789778161.654607:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.654614:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.654639:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.654659:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869376:0@lo:101: 00000100:00100000:1.0:1789778161.654723:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.654766:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778161.655581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314869376 00000100:00100000:0.0:1789778161.655590:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314869376 00000100:00100000:0.0:1789778161.655647:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789778161.655656:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314869376:12345-0@lo:101: 00010000:00010000:0.0:1789778161.655670:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778161.655685:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756a00/0x5a1e1c1157440ca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440ca1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.655706:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756a00/0x5a1e1c1157440ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440ca1 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.655716:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756a00/0x5a1e1c1157440ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440ca1 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.655723:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756a00, rc 0) 00000100:00100000:0.0:1789778161.655768:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314869376:12345-0@lo:101: Request processed in 113us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.655774:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789778161.655848:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869376:0@lo:101: 00010000:00010000:1.0:1789778161.655862:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.655872:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.655926:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869504:0@lo:256: 00000100:00100000:1.0:1789778161.655960:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.655995:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778161.656239:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314869504 00000100:00100000:0.0:1789778161.656250:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314869504 00000100:00100000:0.0:1789778161.656381:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789778161.656391:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314869504:12345-0@lo:256: 20000000:01000000:0.0:1789778161.656406:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789778161.656423:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789778161.656426:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789778161.656508:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314869504:12345-0@lo:256: Request processed in 118us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.656516:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789778161.656593:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869504:0@lo:256: 10000000:01000000:1.0:1789778161.656639:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789778161.656646:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.656655:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778161.656663:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789778161.656665:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789778161.656674:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789778161.656694:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.656702:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.656711:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.656724:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869632:0@lo:101: 00000100:00100000:1.0:1789778161.656750:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.656773:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778161.656816:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314869632 00000100:00100000:0.0:1789778161.656820:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314869632 00000100:00100000:0.0:1789778161.656912:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789778161.656920:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314869632:12345-0@lo:101: 00010000:00010000:0.0:1789778161.656928:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778161.656939:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440caf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.656954:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.656963:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778161.656970:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756000, rc 0) 00000100:00100000:0.0:1789778161.657001:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314869632:12345-0@lo:101: Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.657007:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789778161.666709:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869632:0@lo:101: 00010000:00010000:1.0:1789778161.666748:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.666763:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.666861:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869760:0@lo:501: 00000100:00100000:1.0:1789778161.666926:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.666963:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.666984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314869760 00000100:00100000:1.0:1789778161.666990:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314869760 00000100:00100000:1.0:1789778161.667157:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789778161.667167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314869760:12345-0@lo:501: 00000100:00100000:1.0:1789778161.667501:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314869760:12345-0@lo:501: Request processed in 334us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.667519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789778161.667562:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869760:0@lo:501: 00000100:00100000:1.0:1789778161.667592:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869888:0@lo:503: 00000100:00100000:1.0:1789778161.667627:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.667640:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.667650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314869888 00000100:00100000:1.0:1789778161.667653:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314869888 00000100:00100000:1.0:1789778161.667668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789778161.667673:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314869888:12345-0@lo:503: 00000100:00100000:1.0:1789778161.667941:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314869888:12345-0@lo:503: Request processed in 266us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.667947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789778161.667979:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314869888:0@lo:503: 00000100:00100000:1.0:1789778161.669506:0:7916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7916:1876718314870016:0@lo:502: 00000100:00100000:1.0:1789778161.669562:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.669591:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870016 00000100:00100000:1.0:1789778161.669596:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870016 00000100:00100000:1.0:1789778161.669633:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789778161.669641:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:7916:x1876718314870016:12345-0@lo:502: 00000100:00100000:1.0:1789778161.669922:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:7916:x1876718314870016:12345-0@lo:502: Request processed in 280us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.669931:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789778161.669968:0:7916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.669987:0:7916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7916:1876718314870016:0@lo:502: 00000020:01000000:1.0:1789778161.672199:0:7916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789778161.672216:0:7916:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789778161.672228:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778161.672231:0:7916:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789778161.672240:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789778161.672245:0:7916:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:1.0:1789778161.676510:0:7916:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789778161.676523:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789778161.676542:0:7916:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b3e91fe4d28) 00000020:00000080:1.0:1789778161.676568:0:7916:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789778161.676575:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789778161.676682:0:7916:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789778161.676688:0:7916:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789778161.676695:0:7916:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157440cc4 00010000:00080000:1.0:1789778161.676729:0:7916:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3d82bc1000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1789778161.676972:0:7916:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789778161.684995:0:7916:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789778161.685015:0:7916:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789778161.685591:0:7916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778161.685814:0:7916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778161.685866:0:7916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789778161.685928:0:7916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789778161.687526:0:7917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778161.687534:0:7917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789778161.688636:0:7916:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789778161.688649:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789778161.688686:0:7916:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789778161.688710:0:7916:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157440ccb 00000100:00080000:2.0:1789778161.688724:0:7916:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789778161.688730:0:7916:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3d82bc1000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1789778161.688768:0:7916:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3eb581f800 x1876718314870144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789778161.688801:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314870144:0@lo:8: 00000100:00100000:2.0:1789778161.688869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778161.688927:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870144 00000100:00100000:2.0:1789778161.688935:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870144 00000100:00100000:2.0:1789778161.688983:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778161.688990:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876718314870144:12345-0@lo:8: 00010000:00080000:2.0:1789778161.689203:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:2.0:1789778161.689237:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157440cd2 00002000:00100000:2.0:1789778161.689250:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b3e88cf6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789778161.689255:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789778161.689258:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789778161.689438:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789778161.689586:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789778161.689611:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9b3e88cf3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778161.689663:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876718314870144:12345-0@lo:8: Request processed in 671us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778161.689670:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789778161.689706:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb581f800 x1876718314870144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789778171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778161.689716:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789778161.689723:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789778161.689731:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789778161.689735:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789778161.689737:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3d82bc1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789778161.689749:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789778161.689753:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314870144:0@lo:8: 00000100:00080000:2.0:1789778161.689772:0:7916:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789778161.689830:0:7916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789778161.689836:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789778161.689837:0:7916:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789778161.689841:0:7916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789778161.689844:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789778161.689846:0:7916:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789778161.689849:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789778161.689851:0:7916:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789778161.689883:0:7916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7916:1876718314870272:0@lo:502: 00000100:00100000:2.0:1789778161.689928:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778161.689946:0:7916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627840 going to sleep for 11 seconds 00000004:00080000:2.0:1789778161.689962:0:7917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789778161.692107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870272 00000100:00100000:1.0:1789778161.692122:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870272 00000100:00100000:1.0:1789778161.692192:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789778161.692204:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:7916:x1876718314870272:12345-0@lo:502: 00000100:00100000:1.0:1789778161.692683:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:7916:x1876718314870272:12345-0@lo:502: Request processed in 479us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.692691:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789778161.692760:0:7916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:7916:1876718314870272:0@lo:502: 00000020:01000000:1.0:1789778161.692800:0:7916:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778161.692808:0:7916:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778161.692810:0:7916:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789778161.692813:0:7916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789778161.692878:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789778161.692892:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789778161.692901:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.692912:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778161.692921:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789778161.692924:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b3e85d019b8 from 1 10000000:01000000:1.0:1789778161.692926:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789778161.692964:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.692972:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.692982:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.693000:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314870400:0@lo:101: 00000004:00080000:2.0:1789778161.694837:0:7917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 216652769465ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789778161.696212:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.696258:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb95490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778161.698612:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314870656:0@lo:400: 00000100:00100000:0.0:1789778161.698679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.698724:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778161.698731:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314870528:0@lo:400: 00000100:00100000:0.0:1789778161.698756:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.698782:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314870784:0@lo:400: 00000100:00100000:0.0:1789778161.698808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.700579:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870656 00000100:00100000:0.0:1789778161.700592:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870656 00000100:00100000:0.0:1789778161.700645:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870528 00000100:00100000:0.0:1789778161.700648:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870528 00000100:00100000:0.0:1789778161.700659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870784 00000100:00100000:0.0:1789778161.700662:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870784 00000100:00100000:0.0:1789778161.700686:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789778161.700694:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314870656:12345-0@lo:400: 00000100:00100000:0.0:1789778161.700778:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314870656:12345-0@lo:400: Request processed in 84us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.700785:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789778161.700804:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789778161.700812:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314870528:12345-0@lo:400: 00000100:00100000:0.0:1789778161.700844:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314870528:12345-0@lo:400: Request processed in 33us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.700851:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789778161.700864:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789778161.700870:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314870784:12345-0@lo:400: 00000100:00100000:0.0:1789778161.700901:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314870784:12345-0@lo:400: Request processed in 32us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.700907:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789778161.709596:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5857800 x1876718314870528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778161.709616:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314870528:0@lo:400: 00010000:00080000:1.0:1789778161.709640:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5854e00 x1876718314870656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778161.709649:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314870656:0@lo:400: 00000100:00080000:1.0:1789778161.709684:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778161.709722:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870400 00000100:00100000:1.0:1789778161.709728:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870400 00000100:00100000:1.0:1789778161.709788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789778161.709798:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314870400:12345-0@lo:101: 00010000:00010000:1.0:1789778161.709815:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778161.709835:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440cd9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.709863:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.709874:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.709884:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321c00, rc 0) 00000100:00100000:1.0:1789778161.709956:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314870400:12345-0@lo:101: Request processed in 159us (13749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.709963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789778161.709997:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314870400:0@lo:101: 00010000:00010000:1.0:1789778161.710013:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.710024:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778161.710136:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314870912:0@lo:501: 00000100:00100000:1.0:1789778161.710172:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.710214:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb95490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.710228:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314870912 00000100:00100000:1.0:1789778161.710232:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314870912 00000100:00100000:1.0:1789778161.710252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789778161.710258:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314870912:12345-0@lo:501: 00000100:00100000:1.0:1789778161.710510:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314870912:12345-0@lo:501: Request processed in 250us (337us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789778161.710517:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789778161.710547:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314870912:0@lo:501: 10000000:01000000:1.0:1789778161.710570:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789778161.710577:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778161.710586:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789778161.714208:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5856a00 x1876718314870784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778161.714227:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314870784:0@lo:400: 00000004:00080000:1.0:1789778161.866554:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789778161.983157:0:7918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789778161.983200:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871168:0@lo:7: 00000100:00100000:1.0:1789778161.983293:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.983343:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e838a90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.983385:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314871040:0@lo:13: 00000100:00100000:1.0:1789778161.983410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.983449:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871168 00000100:00100000:1.0:1789778161.983467:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871168 00000100:00100000:1.0:1789778161.984176:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789778161.984195:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7918:x1876718314871168:12345-0@lo:7: 00000100:00080000:0.0:1789778161.989404:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778161.989436:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871040 00000100:00100000:0.0:1789778161.989574:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871040 00000100:00100000:0.0:1789778161.989643:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789778161.989653:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876718314871040:12345-0@lo:13: 00002000:00000024:0.0:1789778161.989686:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789778161.989786:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876718314871040:12345-0@lo:13: Request processed in 134us (6373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778161.989793:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:1.0:1789778161.992542:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789778161.992550:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789778161.992634:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7918:x1876718314871168:12345-0@lo:7: Request processed in 8437us (9337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778161.992645:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789778161.992724:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df3480 x1876718314871040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778161.992749:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314871040:0@lo:13: 00010000:00080000:0.0:1789778161.993674:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df1880 x1876718314871168/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789778177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778161.993688:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871168:0@lo:7: 00000004:00080000:0.0:1789778161.993701:0:7918:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789778161.993736:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871296:0@lo:5: 00000100:00100000:0.0:1789778161.993779:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778161.993816:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.994161:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871296 00000100:00100000:1.0:1789778161.994168:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871296 00000100:00100000:1.0:1789778161.994221:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789778161.994230:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7918:x1876718314871296:12345-0@lo:5: 00002000:00080000:1.0:1789778161.994324:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789778161.994328:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789778161.994822:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7918:x1876718314871296:12345-0@lo:5: Request processed in 590us (1040us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789778161.994829:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789778161.994871:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5857100 x1876718314871296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789778177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778161.994901:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871296:0@lo:5: 00000004:00080000:1.0:1789778161.994910:0:7918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789778161.994937:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871424:0@lo:700: 00000100:00100000:1.0:1789778161.994962:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.994980:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778161.994996:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871424 00000100:00100000:1.0:1789778161.995000:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871424 00000100:00100000:1.0:1789778161.995380:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789778161.995390:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7918:x1876718314871424:12345-0@lo:700: 00000100:00100000:1.0:1789778161.995423:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1876718314871552:0@lo:700: 00000100:00100000:1.0:1789778161.995451:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778161.995590:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9549780 going to sleep for 11 seconds 00000100:00100000:3.0:1789778161.997175:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871552 00000100:00100000:3.0:1789778161.997198:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871552 00000100:00100000:3.0:1789778161.997266:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789778161.997276:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1876718314871552:12345-0@lo:700: 40000000:02000000:0.0:1789778162.097936:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789778162.126670:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1876718314871552:12345-0@lo:700: Request processed in 129385us (131206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778162.126686:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789778162.127625:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df0a80 x1876718314871552/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789778177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778162.127658:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1876718314871552:0@lo:700: 40000000:02000000:3.0:1789778162.127672:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1789778162.309640:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7918:x1876718314871424:12345-0@lo:700: Request processed in 314242us (314666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778162.309656:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1789778162.309793:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789778162.309813:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789778162.310205:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df3480 x1876718314871424/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789778177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778162.310225:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871424:0@lo:700: 00010000:00010000:3.0:1789778162.355864:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:2.0:1789778162.420299:0:7918:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789778162.429511:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871680:0@lo:5: 00000100:00100000:2.0:1789778162.429585:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778162.429649:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789778162.429867:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871680 00000100:00100000:0.0:1789778162.429875:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871680 00000100:00100000:0.0:1789778162.429936:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789778162.429947:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7918:x1876718314871680:12345-0@lo:5: 00002000:00080000:2.0:1789778162.447217:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789778162.447242:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789778162.463571:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7918:x1876718314871680:12345-0@lo:5: Request processed in 33618us (33978us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789778162.463585:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789778162.463644:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb581ed80 x1876718314871680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789778178 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778162.463660:0:7918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789778162.463682:0:7918:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b3eb581ed80 x1876718314871680/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789778178 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778162.463695:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1876718314871680:0@lo:5: 00000004:00080000:2.0:1789778162.463716:0:7918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789778163.394423:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789778163.754442:0:7989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789778164.401538:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778165.426716:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778166.450314:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778166.705680:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314872064:0@lo:400: 00000100:00100000:3.0:1789778166.705760:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778166.705926:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314871808:0@lo:400: 00000100:00100000:1.0:1789778166.705963:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778166.705995:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778166.706001:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314871936:0@lo:400: 00000100:00100000:1.0:1789778166.706030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778166.706059:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314872192:0@lo:400: 00000100:00100000:1.0:1789778166.706130:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778166.706177:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872064 00000100:00100000:1.0:1789778166.706182:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871808 00000100:00100000:2.0:1789778166.706185:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872064 00000100:00100000:1.0:1789778166.706212:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871808 00000100:00100000:2.0:1789778166.706242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314871936 00000100:00100000:1.0:1789778166.706242:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789778166.706244:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314871936 00000100:00100000:1.0:1789778166.706250:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314871808:12345-0@lo:400: 00000100:00100000:2.0:1789778166.706257:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789778166.706262:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314872064:12345-0@lo:400: 00000100:00100000:1.0:1789778166.706292:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314871808:12345-0@lo:400: Request processed in 43us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778166.706299:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789778166.706330:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789778166.706337:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789778166.706352:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872192 00000100:00100000:1.0:1789778166.706355:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872192 00000100:00100000:1.0:1789778166.706382:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778166.706388:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314872192:12345-0@lo:400: 00000100:00100000:1.0:1789778166.706422:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314872192:12345-0@lo:400: Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778166.706428:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778166.706448:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789778166.706455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789778166.706461:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314871936:12345-0@lo:400: 00000100:00100000:1.0:1789778166.706929:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314871936:12345-0@lo:400: Request processed in 466us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778166.706936:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789778166.707080:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789778166.707091:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314872320:0@lo:13: 00000100:00100000:1.0:1789778166.707129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789778166.707172:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5854e00 x1876718314872192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778166.707186:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314872192:0@lo:400: 00000100:00080000:0.0:1789778166.707368:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789778166.707373:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778166.707403:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872320 00000100:00100000:0.0:1789778166.707413:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872320 00000100:00100000:0.0:1789778166.707448:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789778166.707455:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314872320:12345-0@lo:13: 00002000:00000024:0.0:1789778166.707501:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778166.707537:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314872320:12345-0@lo:13: Request processed in 83us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778166.707543:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789778166.707563:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314872448:0@lo:400: 00000100:00100000:0.0:1789778166.707586:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789778166.707610:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df1880 x1876718314872320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778166.707625:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314872320:0@lo:13: 00000100:00100000:0.0:1789778166.707647:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789778166.707653:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872448 00000100:00100000:0.0:1789778166.707656:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872448 00000100:00100000:0.0:1789778166.707675:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789778166.707681:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789778166.707686:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314872448:12345-0@lo:400: 00000100:00100000:0.0:1789778166.707719:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314872448:12345-0@lo:400: Request processed in 32us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778166.707725:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789778166.707751:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789778166.707767:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5857800 x1876718314872448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778166.707785:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314872448:0@lo:400: 00010000:00080000:0.0:1789778166.707820:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5857100 x1876718314871936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778166.707829:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314871936:0@lo:400: 00000100:00100000:0.0:1789778166.707847:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314871808:0@lo:400: 00000100:00100000:1.0:1789778166.708688:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789778166.708701:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314872576:0@lo:400: 00000100:00100000:1.0:1789778166.708744:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778166.708868:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872576 00000100:00100000:0.0:1789778166.708874:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872576 00000100:00100000:0.0:1789778166.708980:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789778166.708990:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314872576:12345-0@lo:400: 00000100:00100000:0.0:1789778166.709030:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314872576:12345-0@lo:400: Request processed in 43us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778166.709035:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789778166.709331:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778166.709357:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314872064:12345-0@lo:400: Request processed in 3093us (3595us total) trans 0 rc 0/0 00010000:00080000:1.0:1789778166.709358:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5857b80 x1876718314872576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778166.709365:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789778166.709371:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314872576:0@lo:400: 00010000:00080000:3.0:1789778166.709735:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5856a00 x1876718314872064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778166.709849:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314872064:0@lo:400: 00000100:00100000:3.0:1789778167.231613:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314872704:0@lo:13: 00000100:00100000:3.0:1789778167.231690:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778167.231941:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872704 00000100:00100000:3.0:1789778167.231949:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872704 00000100:00100000:3.0:1789778167.231998:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778167.232005:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314872704:12345-0@lo:13: 00002000:00000024:3.0:1789778167.232048:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778167.232149:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314872704:12345-0@lo:13: Request processed in 143us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778167.232157:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789778167.232222:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec176ad80 x1876718314872704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778167.232243:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314872704:0@lo:13: 00000001:00080000:0.0:1789778167.365149:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789778167.474169:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778168.498163:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778169.524408:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778170.207974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778170.210705:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974016 00000100:00100000:2.0:1789778170.210722:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974016 00000100:00100000:2.0:1789778170.210782:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:2.0:1789778170.210790:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2371:x1876718295974016:12345-192.168.201.45@tcp:250: 00010000:00080000:2.0:1789778170.210819:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 14cc3ffd-125e-4ebe-b788-5465d0332197@192.168.201.45@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:2.0:1789778170.210852:0:5839:0:(genops.c:1385:class_connect()) connect: client 14cc3ffd-125e-4ebe-b788-5465d0332197, cookie 0x5a1e1c1157440ce7 00000100:00080000:2.0:1789778170.211020:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9b3e88cf3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778170.212018:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+5:2371:x1876718295974016:12345-192.168.201.45@tcp:250: Request processed in 1220us (4050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778170.212040:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:1.0:1789778170.228488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778170.228526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974144 00000100:00100000:1.0:1789778170.228535:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974144 00000100:00100000:1.0:1789778170.228588:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:1.0:1789778170.228598:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+5:5615:x1876718295974144:12345-192.168.201.45@tcp:101: 00010000:00010000:1.0:1789778170.228615:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778170.228632:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a1e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778170.228662:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778170.228673:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778170.228681:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320400, rc 0) 00000100:00100000:1.0:1789778170.228730:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+6:5615:x1876718295974144:12345-192.168.201.45@tcp:101: Request processed in 135us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778170.228737:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:2.0:1789778170.236536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778170.236586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974272 00000100:00100000:2.0:1789778170.236600:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974272 00000100:00100000:2.0:1789778170.236655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:2.0:1789778170.236665:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+6:5615:x1876718295974272:12345-192.168.201.45@tcp:501: 00000100:00100000:2.0:1789778170.237022:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+6:5615:x1876718295974272:12345-192.168.201.45@tcp:501: Request processed in 356us (494us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789778170.237039:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:1.0:1789778170.243787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778170.245145:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974400 00000100:00100000:2.0:1789778170.245161:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974400 00000100:00100000:2.0:1789778170.245230:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:2.0:1789778170.245239:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+6:5615:x1876718295974400:12345-192.168.201.45@tcp:101: 00010000:00010000:2.0:1789778170.245257:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778170.245276:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a25 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778170.245304:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778170.245315:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778170.245326:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656800, rc 0) 00000100:00100000:2.0:1789778170.245577:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+7:5615:x1876718295974400:12345-192.168.201.45@tcp:101: Request processed in 338us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778170.245585:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:2.0:1789778170.255928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778170.256023:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974528 00000100:00100000:1.0:1789778170.256043:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974528 00000100:00100000:1.0:1789778170.256125:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:1.0:1789778170.256135:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+7:5615:x1876718295974528:12345-192.168.201.45@tcp:501: 00000100:00100000:1.0:1789778170.256432:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5615:x1876718295974528:12345-192.168.201.45@tcp:501: Request processed in 296us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778170.256441:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:2.0:1789778170.274007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778170.277139:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974656 00000100:00100000:1.0:1789778170.277156:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974656 00000100:00100000:1.0:1789778170.277233:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:1.0:1789778170.277244:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5615:x1876718295974656:12345-192.168.201.45@tcp:503: 00000100:00100000:1.0:1789778170.277591:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5615:x1876718295974656:12345-192.168.201.45@tcp:503: Request processed in 347us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778170.277600:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:1.0:1789778170.288961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778170.289199:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974784 00000100:00100000:3.0:1789778170.289212:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974784 00000100:00100000:3.0:1789778170.289271:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:3.0:1789778170.289281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5633:x1876718295974784:12345-192.168.201.45@tcp:502: 00000100:00100000:3.0:1789778170.289654:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5633:x1876718295974784:12345-192.168.201.45@tcp:502: Request processed in 372us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778170.289663:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:3.0:1789778170.342326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778170.349546:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295974912 00000100:00100000:2.0:1789778170.349563:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295974912 00000100:00100000:2.0:1789778170.349631:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:2.0:1789778170.349642:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5633:x1876718295974912:12345-192.168.201.45@tcp:502: 00000100:00100000:2.0:1789778170.350020:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5633:x1876718295974912:12345-192.168.201.45@tcp:502: Request processed in 379us (7703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778170.350038:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:1.0:1789778170.368307:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778170.370685:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975040 00000100:00100000:2.0:1789778170.370705:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975040 00000100:00100000:2.0:1789778170.370784:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:2.0:1789778170.370795:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5615:x1876718295975040:12345-192.168.201.45@tcp:101: 00010000:00010000:2.0:1789778170.370816:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778170.370835:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657e00/0x5a1e1c1157440cfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778170.370865:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657e00/0x5a1e1c1157440cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a4f expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778170.370876:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657e00/0x5a1e1c1157440cfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a4f expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778170.370887:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657e00, rc 0) 00000100:00100000:2.0:1789778170.370966:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5615:x1876718295975040:12345-192.168.201.45@tcp:101: Request processed in 171us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778170.370973:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:1.0:1789778170.401041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778170.401409:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975168 00000100:00100000:3.0:1789778170.401420:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975168 00000100:00100000:3.0:1789778170.401479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:3.0:1789778170.401490:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5615:x1876718295975168:12345-192.168.201.45@tcp:256: 20000000:01000000:3.0:1789778170.401514:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789778170.401538:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789778170.401543:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789778170.401546:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789778170.401548:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789778170.413419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5615:x1876718295975168:12345-192.168.201.45@tcp:256: Request processed in 11918us (12382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778170.413435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:0.0:1789778170.419993:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778170.420097:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975296 00000100:00100000:3.0:1789778170.420109:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975296 00000100:00100000:3.0:1789778170.420355:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:3.0:1789778170.420367:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5615:x1876718295975296:12345-192.168.201.45@tcp:101: 00010000:00010000:3.0:1789778170.420385:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778170.420402:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778170.420448:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778170.420459:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778170.420468:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f000, rc 0) 00000100:00100000:3.0:1789778170.420530:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5615:x1876718295975296:12345-192.168.201.45@tcp:101: Request processed in 165us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778170.420537:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:1.0:1789778170.427880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778170.428310:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975424 00000100:00100000:3.0:1789778170.428323:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975424 00000100:00100000:3.0:1789778170.428373:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:3.0:1789778170.428384:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5615:x1876718295975424:12345-192.168.201.45@tcp:501: 00000100:00100000:3.0:1789778170.428678:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5615:x1876718295975424:12345-192.168.201.45@tcp:501: Request processed in 295us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778170.428686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:0.0:1789778170.445483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778170.445526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975552 00000100:00100000:0.0:1789778170.445537:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975552 00000100:00100000:0.0:1789778170.445592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:0.0:1789778170.445603:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5615:x1876718295975552:12345-192.168.201.45@tcp:503: 00000100:00100000:0.0:1789778170.445989:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5615:x1876718295975552:12345-192.168.201.45@tcp:503: Request processed in 386us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778170.445998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:1.0:1789778170.462136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778170.466531:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975680 00000100:00100000:3.0:1789778170.466551:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975680 00000100:00100000:3.0:1789778170.466624:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:3.0:1789778170.466636:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5638:x1876718295975680:12345-192.168.201.45@tcp:502: 00000100:00100000:3.0:1789778170.466951:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5638:x1876718295975680:12345-192.168.201.45@tcp:502: Request processed in 316us (4825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778170.466960:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:2.0:1789778170.470443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778170.471198:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975808 00000100:00100000:3.0:1789778170.471224:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975808 00000100:00100000:3.0:1789778170.471283:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:3.0:1789778170.471294:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5638:x1876718295975808:12345-192.168.201.45@tcp:502: 00000100:00100000:3.0:1789778170.472105:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5638:x1876718295975808:12345-192.168.201.45@tcp:502: Request processed in 772us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778170.472123:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:1.0:1789778170.488758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778170.493630:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295975936 00000100:00100000:0.0:1789778170.493646:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295975936 00000100:00100000:2.0:1789778170.501490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1789778170.501501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2371:x1876718295975936:12345-192.168.201.45@tcp:38: 00010000:00080000:2.0:1789778170.501533:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:2.0:1789778170.501591:0:5845:0:(genops.c:1385:class_connect()) connect: client bdd103b9-ae1a-4bf0-9cc3-bcece875c39a, cookie 0x5a1e1c1157440d0a 00000004:00100000:2.0:1789778170.501644:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789778170.501650:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789778170.546937:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789778170.555394:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9b3d82bc0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789778170.555480:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2371:x1876718295975936:12345-192.168.201.45@tcp:38: Request processed in 53976us (66731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778170.555492:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1789778171.563253:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778171.563296:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778171.563469:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976192 00000100:00100000:0.0:1789778171.563481:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976192 00000100:00100000:0.0:1789778171.563607:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976064 00000100:00100000:0.0:1789778171.563612:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976064 00000100:00100000:0.0:1789778171.563640:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1789778171.563652:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:5615:x1876718295976192:12345-192.168.201.45@tcp:41: 00000004:00000024:0.0:1789778171.563706:0:8093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789778171.563783:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1789778171.563792:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:5615:x1876718295976192:12345-192.168.201.45@tcp:41: Request processed in 140us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778171.563799:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:0:x1876718295976064:12345-192.168.201.45@tcp:41: 00000100:00100000:0.0:1789778171.563808:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000004:00000024:3.0:1789778171.563818:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789778171.563849:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:0:x1876718295976064:12345-192.168.201.45@tcp:41: Request processed in 58us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778171.563856:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00080000:1.0:1789778171.564876:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778171.568605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778171.568844:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976320 00000100:00100000:0.0:1789778171.568856:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976320 00000100:00100000:0.0:1789778171.568983:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778171.568996:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:5615:x1876718295976320:12345-192.168.201.45@tcp:40: 00000100:00100000:0.0:1789778171.569156:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:5615:x1876718295976320:12345-192.168.201.45@tcp:40: Request processed in 161us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778171.569165:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00010000:00010000:1.0:1789778171.570091:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778171.585539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778171.585665:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976448 00000100:00100000:1.0:1789778171.585674:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976448 00000100:00100000:1.0:1789778171.585723:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1789778171.585730:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2371:x1876718295976448:12345-192.168.201.45@tcp:8: 00010000:00080000:1.0:1789778171.585760:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1789778171.585791:0:6693:0:(genops.c:1385:class_connect()) connect: client bdd103b9-ae1a-4bf0-9cc3-bcece875c39a, cookie 0x5a1e1c1157440d11 00002000:00100000:1.0:1789778171.585804:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bdd103b9-ae1a-4bf0-9cc3-bcece875c39a/ffff9b3d82bc7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789778171.585830:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789778171.586090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778171.586116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778171.586160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00002000:00080000:1.0:1789778171.586169:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789778171.586183:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976832 00000100:00100000:0.0:1789778171.586186:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976832 00000100:00080000:1.0:1789778171.586197:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9b3d82bc3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778171.586214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:0.0:1789778171.586232:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2375:x1876718295976832:12345-192.168.201.45@tcp:400: 00000100:00100000:0.0:1789778171.586284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2375:x1876718295976832:12345-192.168.201.45@tcp:400: Request processed in 63us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778171.586291:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:0.0:1789778171.586335:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789778171.586342:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789778171.586442:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976704 00000100:00100000:3.0:1789778171.586447:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976704 00000100:00100000:0.0:1789778171.586449:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976576 00000100:00100000:0.0:1789778171.586451:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976576 00000100:00100000:3.0:1789778171.586472:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1789778171.586478:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:5615:x1876718295976704:12345-192.168.201.45@tcp:33: 00000100:00100000:0.0:1789778171.586519:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1789778171.586529:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2371:x1876718295976576:12345-192.168.201.45@tcp:8: 00010000:00080000:0.0:1789778171.586544:0:8205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1789778171.586563:0:8205:0:(genops.c:1385:class_connect()) connect: client bdd103b9-ae1a-4bf0-9cc3-bcece875c39a, cookie 0x5a1e1c1157440d18 00002000:00100000:0.0:1789778171.586569:0:8205:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bdd103b9-ae1a-4bf0-9cc3-bcece875c39a/ffff9b3ebf39a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789778171.586585:0:8205:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789778171.590109:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2371:x1876718295976448:12345-192.168.201.45@tcp:8: Request processed in 4365us (4568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778171.590124:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00002000:00080000:0.0:1789778171.590392:0:8205:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789778171.590435:0:8205:0:(import.c:65:import_set_state_nolock()) ffff9b3eb5811800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778171.590487:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2371:x1876718295976576:12345-192.168.201.45@tcp:8: Request processed in 3957us (4370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778171.590495:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000004:00080000:3.0:1789778171.626648:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 40117us 00000004:00200000:2.0:1789778171.640436:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789778171.640669:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:5615:x1876718295976704:12345-192.168.201.45@tcp:33: Request processed in 54183us (54572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778171.640686:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1789778171.765442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778171.765490:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295976960 00000100:00100000:3.0:1789778171.765500:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295976960 00000100:00100000:3.0:1789778171.765556:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:3.0:1789778171.765565:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:5655:x1876718295976960:12345-192.168.201.45@tcp:101: 00010000:00010000:3.0:1789778171.765581:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778171.765601:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150fc00/0x5a1e1c1157440d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a80 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778171.765670:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e400/0x5a1e1c1157440d26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778171.765680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e400/0x5a1e1c1157440d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778171.765692:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e400/0x5a1e1c1157440d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778171.765725:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789778171.765730:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789778171.765748:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e400/0x5a1e1c1157440d26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778171.765774:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150fc00/0x5a1e1c1157440d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a80 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778171.765792:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e400/0x5a1e1c1157440d26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a80 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778171.765798:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e82bb5000) 00010000:00010000:3.0:1789778171.765800:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789778171.765802:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150e400, rc 0) 00000100:00100000:3.0:1789778171.765862:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:5655:x1876718295976960:12345-192.168.201.45@tcp:101: Request processed in 297us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778171.765869:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:3.0:1789778171.826243:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314872960:0@lo:400: 00000100:00100000:3.0:1789778171.826326:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778171.826404:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314873472:0@lo:400: 00000100:00100000:3.0:1789778171.826432:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778171.826464:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789778171.826476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314872832:0@lo:400: 00000100:00100000:3.0:1789778171.826503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778171.826523:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314873344:0@lo:400: 00000100:00100000:0.0:1789778171.826666:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314873216:0@lo:400: 00000100:00100000:0.0:1789778171.826696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778171.826715:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789778171.826721:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314873088:0@lo:400: 00000100:00100000:0.0:1789778171.826754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872960 00000100:00100000:0.0:1789778171.826762:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872960 00000100:00100000:0.0:1789778171.826806:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789778171.826815:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314872960:12345-0@lo:400: 00000100:00100000:1.0:1789778171.826823:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314873600:0@lo:13: 00000100:00100000:0.0:1789778171.826861:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314872960:12345-0@lo:400: Request processed in 47us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778171.826866:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778171.826869:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789778171.826895:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873600 00000100:00100000:1.0:1789778171.826898:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873600 00000100:00100000:0.0:1789778171.826907:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873472 00000100:00100000:0.0:1789778171.826909:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873472 00000100:00100000:0.0:1789778171.826929:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873216 00000100:00100000:0.0:1789778171.826931:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873216 00000100:00100000:1.0:1789778171.826932:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789778171.826938:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314873600:12345-0@lo:13: 00000100:00100000:0.0:1789778171.826947:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00002000:00000024:1.0:1789778171.826953:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778171.826958:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314873472:12345-0@lo:400: 00000100:00100000:0.0:1789778171.826981:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314873472:12345-0@lo:400: Request processed in 23us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778171.826982:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314873600:12345-0@lo:13: Request processed in 45us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778171.826987:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789778171.826988:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789778171.826998:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789778171.827018:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314873216:12345-0@lo:400: 00010000:00080000:1.0:1789778171.827034:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec0d7b100 x1876718314873600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778171.827045:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314873216:12345-0@lo:400: Request processed in 42us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778171.827051:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789778171.827059:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314873600:0@lo:13: 00000100:00080000:0.0:1789778171.827096:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789778171.827100:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778171.827113:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314872832 00000100:00100000:0.0:1789778171.827116:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314872832 00000100:00100000:0.0:1789778171.827148:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789778171.827154:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314872832:12345-0@lo:400: 00000100:00100000:0.0:1789778171.827183:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314872832:12345-0@lo:400: Request processed in 30us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778171.827189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789778171.827314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778171.827362:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314872960:0@lo:400: 00010000:00080000:3.0:1789778171.827373:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec1768e00 x1876718314873472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778171.827380:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789778171.827390:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314873472:0@lo:400: 00000100:00100000:3.0:1789778171.827403:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314872832:0@lo:400: 00000100:00100000:0.0:1789778171.827779:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873344 00000100:00100000:0.0:1789778171.827784:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873344 00000100:00100000:0.0:1789778171.827826:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789778171.827833:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314873344:12345-0@lo:400: 00000100:00100000:0.0:1789778171.827872:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314873344:12345-0@lo:400: Request processed in 39us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778171.827877:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789778171.828405:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789778171.828455:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec1769180 x1876718314873216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778171.828466:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314873216:0@lo:400: 00000100:00080000:3.0:1789778171.830016:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778171.830046:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873088 00000100:00100000:3.0:1789778171.830057:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873088 00000100:00100000:2.0:1789778171.830223:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314873344:0@lo:400: 00000100:00100000:3.0:1789778171.830501:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789778171.830509:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314873088:12345-0@lo:400: 00000100:00100000:3.0:1789778171.830951:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314873088:12345-0@lo:400: Request processed in 439us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778171.830959:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778171.832398:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314873088:0@lo:400: 00000100:00080000:2.0:1789778171.832929:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778172.337614:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314873728:0@lo:13: 00000100:00100000:0.0:1789778172.337691:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778172.337839:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873728 00000100:00100000:1.0:1789778172.337848:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873728 00000100:00100000:1.0:1789778172.337900:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789778172.337910:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314873728:12345-0@lo:13: 00002000:00000024:1.0:1789778172.337934:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778172.338822:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314873728:12345-0@lo:13: Request processed in 910us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778172.338831:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789778172.339634:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec176ad80 x1876718314873728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778172.339658:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314873728:0@lo:13: 00000001:00100000:0.0:1789778172.395450:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00010000:00010000:3.0:1789778172.594517:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778173.617318:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778173.990182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778173.990573:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977088 00000100:00100000:2.0:1789778173.990582:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977088 00000100:00100000:2.0:1789778173.990643:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1789778173.990652:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:5708:x1876718295977088:12345-192.168.201.45@tcp:41: 00000004:00000024:2.0:1789778173.990689:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789778173.990752:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:5708:x1876718295977088:12345-192.168.201.45@tcp:41: Request processed in 101us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778173.990759:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00080000:3.0:1789778173.992192:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778173.992955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778173.993046:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977216 00000100:00100000:1.0:1789778173.993055:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977216 00000100:00100000:1.0:1789778173.993133:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1789778173.993141:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:5708:x1876718295977216:12345-192.168.201.45@tcp:13: 00002000:00000024:1.0:1789778173.993175:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778173.993224:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:5708:x1876718295977216:12345-192.168.201.45@tcp:13: Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778173.993228:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00080000:3.0:1789778173.993458:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778173.995641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778173.995800:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977344 00000100:00100000:3.0:1789778173.995822:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977344 00000100:00100000:3.0:1789778173.995896:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:3.0:1789778173.995907:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:5708:x1876718295977344:12345-192.168.201.45@tcp:13: 00002000:00000024:3.0:1789778173.995947:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778173.996026:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:5708:x1876718295977344:12345-192.168.201.45@tcp:13: Request processed in 120us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778173.996034:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00080000:2.0:1789778173.996211:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789778174.650364:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778175.669538:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789778175.992904:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000001:00100000:0.0:1789778175.994321:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00010000:00010000:3.0:1789778176.689487:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778176.783781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778176.783837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778176.783872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778176.783895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778176.783932:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977728 00000100:00100000:1.0:1789778176.783942:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977728 00000100:00100000:1.0:1789778176.783996:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977856 00000100:00100000:1.0:1789778176.784000:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977856 00000100:00100000:1.0:1789778176.784023:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1789778176.784033:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295977728:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1789778176.784144:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295977728:12345-192.168.201.45@tcp:400: Request processed in 100us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778176.784153:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1789778176.784172:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1789778176.784179:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295977856:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1789778176.784205:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295977856:12345-192.168.201.45@tcp:400: Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778176.784223:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1789778176.784631:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977600 00000100:00100000:3.0:1789778176.784636:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977600 00000100:00100000:3.0:1789778176.784687:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:3.0:1789778176.784695:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718295977600:12345-192.168.201.45@tcp:400: 00000100:00100000:3.0:1789778176.784735:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718295977600:12345-192.168.201.45@tcp:400: Request processed in 42us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778176.784741:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:2.0:1789778176.784950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977472 00000100:00100000:2.0:1789778176.784955:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977472 00000100:00100000:2.0:1789778176.784988:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:2.0:1789778176.784994:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2375:x1876718295977472:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1789778176.785028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2375:x1876718295977472:12345-192.168.201.45@tcp:400: Request processed in 34us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778176.785033:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00080000:2.0:1789778176.785092:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789778176.785096:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789778176.785098:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778176.945434:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314874240:0@lo:400: 00000100:00100000:0.0:1789778176.945508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778176.945578:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789778176.945591:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314874112:0@lo:400: 00000100:00100000:0.0:1789778176.945620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778176.945654:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314874240 00000100:00100000:0.0:1789778176.945662:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314874240 00000100:00100000:0.0:1789778176.945729:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789778176.945738:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314874240:12345-0@lo:400: 00000100:00100000:0.0:1789778176.945789:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314874240:12345-0@lo:400: Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778176.945796:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789778176.945818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314874112 00000100:00100000:0.0:1789778176.945822:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314874112 00000100:00100000:0.0:1789778176.945847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789778176.945853:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314874112:12345-0@lo:400: 00000100:00100000:0.0:1789778176.945881:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314874112:12345-0@lo:400: Request processed in 28us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778176.945888:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789778176.945924:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789778176.945929:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778176.945962:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314874112:0@lo:400: 00010000:00080000:0.0:1789778176.945975:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfb65880 x1876718314874240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778176.945985:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314874240:0@lo:400: 00000100:00100000:2.0:1789778176.946103:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314873984:0@lo:400: 00000100:00100000:2.0:1789778176.946132:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778176.946150:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314874496:0@lo:400: 00000100:00100000:2.0:1789778176.946182:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778176.946209:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789778176.946216:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314873856:0@lo:400: 00000100:00100000:2.0:1789778176.946244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778176.946266:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314874368:0@lo:400: 00000100:00100000:2.0:1789778176.946287:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778176.946313:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314874496 00000100:00100000:2.0:1789778176.946317:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314874496 00000100:00100000:2.0:1789778176.946349:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789778176.946355:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314874496:12345-0@lo:400: 00000100:00100000:2.0:1789778176.946390:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314874496:12345-0@lo:400: Request processed in 35us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778176.946396:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789778176.946415:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873856 00000100:00100000:2.0:1789778176.946418:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873856 00000100:00100000:2.0:1789778176.946442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789778176.946448:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314873856:12345-0@lo:400: 00000100:00100000:2.0:1789778176.946475:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314873856:12345-0@lo:400: Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778176.946481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789778176.946512:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314873984 00000100:00100000:2.0:1789778176.946522:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314873984 00000100:00100000:2.0:1789778176.946542:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314874368 00000100:00100000:2.0:1789778176.946545:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314874368 00000100:00100000:2.0:1789778176.946564:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789778176.946569:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314873984:12345-0@lo:400: 00000100:00100000:2.0:1789778176.946598:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314873984:12345-0@lo:400: Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778176.946603:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789778176.946614:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789778176.946619:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314874368:12345-0@lo:400: 00000100:00100000:2.0:1789778176.946640:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314874368:12345-0@lo:400: Request processed in 22us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778176.946645:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789778176.946664:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789778176.946667:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778176.946683:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314873856:0@lo:400: 00000100:00100000:2.0:1789778176.946694:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314874368:0@lo:400: 00000100:00100000:2.0:1789778176.946702:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314873984:0@lo:400: 00010000:00080000:2.0:1789778176.946710:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfb66300 x1876718314874496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778176.946718:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314874496:0@lo:400: 00000100:00100000:3.0:1789778176.948153:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314874624:0@lo:13: 00000100:00100000:3.0:1789778176.948220:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778176.948295:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314874624 00000100:00100000:1.0:1789778176.948303:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314874624 00000100:00100000:1.0:1789778176.948353:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789778176.948362:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314874624:12345-0@lo:13: 00002000:00000024:1.0:1789778176.948405:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778176.948698:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314874624:12345-0@lo:13: Request processed in 336us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778176.948705:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789778176.948830:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98614380 x1876718314874624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778176.948849:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314874624:0@lo:13: 00000001:02000400:2.0:1789778177.222273:0:8295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789778177.461149:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778177.461176:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314874752:0@lo:13: 00000100:00100000:2.0:1789778177.461246:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778177.463123:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314874752 00000100:00100000:0.0:1789778177.463136:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314874752 00000100:00100000:0.0:1789778177.463230:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789778177.463241:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314874752:12345-0@lo:13: 00002000:00000024:0.0:1789778177.463296:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778177.463371:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314874752:12345-0@lo:13: Request processed in 131us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778177.463378:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789778177.463714:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98615180 x1876718314874752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778177.463736:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314874752:0@lo:13: 00010000:00010000:2.0:1789778177.716617:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778178.738314:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778179.765606:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778180.786759:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789778180.862586:0:8443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff34c4600 20000000:00000080:3.0:1789778180.862604:0:8443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3ec144c400 uarg=0000000000000000 20000000:01000000:3.0:1789778180.862655:0:8443:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789778180.862658:0:8443:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789778180.862666:0:8443:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789778180.862671:0:8443:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789778180.862676:0:8443:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789778180.862698:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789778180.862701:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789778180.863325:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789778180.863329:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789778180.863993:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789778180.864509:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789778180.864578:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789778180.864614:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789778180.864626:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789778180.864628:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789778180.865342:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789778180.865643:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789778180.869946:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789778180.870051:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789778180.870089:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789778180.870093:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789778180.884419:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789778180.894818:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789778180.894909:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789778180.894959:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789778180.894972:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789778180.894975:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789778180.899150:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789778180.899849:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789778180.899904:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789778180.899957:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1789778180.899975:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789778180.899994:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900011:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900029:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900035:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900043:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900049:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900055:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900085:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900095:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900103:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900111:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900154:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900194:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 9 pid: 5840 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.900210:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314874880:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778180.900327:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900337:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 9 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.900345:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875008:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778180.900372:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900380:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 18 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.900388:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875136:0@lo:104: 00000100:00100000:0.0:1789778180.900428:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789778180.900462:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900469:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 18 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.900476:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875264:0@lo:104: 00000100:00100000:0.0:1789778180.900496:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789778180.900525:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778180.900528:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789778180.900534:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 18 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778180.900540:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314875136 00000100:00100000:0.0:1789778180.900541:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875392:0@lo:104: 00000100:00100000:2.0:1789778180.900545:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314875136 00000100:00100000:0.0:1789778180.900558:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789778180.900572:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778180.900576:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314875264 00000100:00100000:2.0:1789778180.900579:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314875264 00010000:00010000:0.0:1789778180.900580:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 18 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778180.900588:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314875392 00000100:00100000:0.0:1789778180.900588:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875520:0@lo:104: 00000100:00100000:2.0:1789778180.900590:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314875392 00000100:00100000:2.0:1789778180.900602:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789778180.900604:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.900609:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:8443:x1876718314875136:12345-0@lo:104: 00010000:00010000:0.0:1789778180.900617:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.900621:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778180.900624:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 18 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.900631:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875648:0@lo:104: 00000100:00100000:0.0:1789778180.900648:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789778180.900660:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789778180.900664:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778180.900666:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:8443:x1876718314875136:12345-0@lo:104: Request processed in 57us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778180.900672:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789778180.900672:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 18 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.900678:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875776:0@lo:104: 00000100:00100000:2.0:1789778180.900686:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314875520 00000100:00100000:2.0:1789778180.900689:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314875520 00000100:00100000:2.0:1789778180.900698:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314875648 00000100:00100000:2.0:1789778180.900700:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314875648 00000100:00100000:0.0:1789778180.900703:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.900708:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314875776 00000100:00100000:2.0:1789778180.900710:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314875776 00010000:00010000:0.0:1789778180.900718:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778180.900719:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789778180.900724:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:8443:x1876718314875264:12345-0@lo:104: 00010000:00010000:0.0:1789778180.900726:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 18 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.900730:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.900733:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875904:0@lo:104: 00000100:00100000:0.0:1789778180.900750:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778180.900761:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eabb95a80 going to sleep for 11 seconds 00010000:00010000:2.0:1789778180.900770:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789778180.900774:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:8443:x1876718314875264:12345-0@lo:104: Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778180.900779:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875136:0@lo:104: 00000100:00100000:2.0:1789778180.900786:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789778180.900787:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875264:0@lo:104: 00000100:00100000:2.0:1789778180.900810:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314875904 00000100:00100000:2.0:1789778180.900813:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314875904 00000100:00100000:2.0:1789778180.900825:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789778180.900830:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:8443:x1876718314875392:12345-0@lo:104: 00010000:00010000:2.0:1789778180.900837:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.900889:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789778180.900893:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+7:8443:x1876718314875392:12345-0@lo:104: Request processed in 63us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778180.900899:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789778180.900910:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789778180.900915:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:8443:x1876718314875520:12345-0@lo:104: 00010000:00010000:2.0:1789778180.900921:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.900957:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789778180.900962:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+6:8443:x1876718314875520:12345-0@lo:104: Request processed in 47us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778180.900968:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789778180.900979:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789778180.900984:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:8443:x1876718314875648:12345-0@lo:104: 00010000:00010000:2.0:1789778180.900990:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901013:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789778180.901022:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:8443:x1876718314875648:12345-0@lo:104: Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778180.901028:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789778180.901039:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789778180.901044:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:8443:x1876718314875776:12345-0@lo:104: 00010000:00010000:2.0:1789778180.901051:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901135:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789778180.901140:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:8443:x1876718314875776:12345-0@lo:104: Request processed in 97us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778180.901146:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789778180.901157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789778180.901162:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:8443:x1876718314875904:12345-0@lo:104: 00010000:00010000:2.0:1789778180.901169:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901192:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789778180.901196:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:8443:x1876718314875904:12345-0@lo:104: Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778180.901201:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789778180.901217:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789778180.901222:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901229:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778180.901232:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901251:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778180.901257:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778180.901262:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778180.901287:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901292:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778180.901309:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901315:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3d82321a00/0x5a1e1c1157440cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440ce0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901324:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789778180.901327:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901332:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3400 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778180.901334:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901340:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778180.901346:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778180.901356:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778180.901369:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901374:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778180.901379:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901386:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3400/0x5a1e1c1157440caf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440cb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901396:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789778180.901399:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901404:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756400 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778180.901407:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901413:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778180.901420:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778180.901425:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778180.901436:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901442:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778180.901461:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901468:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157440c93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901479:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789778180.901482:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901488:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778180.901490:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901495:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778180.901500:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778180.901505:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778180.901516:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901521:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778180.901526:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901531:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2800/0x5a1e1c1157440c85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901539:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789778180.901547:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901553:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2c00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778180.901555:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901561:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778180.901567:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778180.901572:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778180.901584:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901590:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778180.901594:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901600:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f2c00/0x5a1e1c1157440c77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901609:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778180.901612:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901617:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778180.901620:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901635:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778180.901640:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778180.901645:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778180.901658:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901662:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778180.901666:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901672:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440c4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c54 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901680:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778180.901683:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901689:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657600 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778180.901691:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901698:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778180.901703:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778180.901716:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778180.901730:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901737:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778180.901741:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901746:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e81657600/0x5a1e1c1157440c23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c2a expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.901758:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778180.901760:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778180.901762:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778180.901774:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876032:0@lo:103: 00000100:00100000:2.0:1789778180.901804:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.901821:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876544:0@lo:103: 00000100:00100000:2.0:1789778180.901851:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.901871:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789778180.901877:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876160:0@lo:103: 00000100:00100000:2.0:1789778180.901896:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.901911:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876672:0@lo:103: 00000100:00100000:2.0:1789778180.901928:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.901947:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314876288:0@lo:103: 00000100:00100000:2.0:1789778180.901965:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.901974:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314876800:0@lo:103: 00000100:00100000:2.0:1789778180.901996:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.902007:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778180.902011:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314876416:0@lo:103: 00000100:00100000:2.0:1789778180.902030:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778180.902051:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876032 00000100:00100000:2.0:1789778180.902056:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876032 00000100:00100000:1.0:1789778180.902768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876544 00000100:00100000:1.0:1789778180.902774:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876544 00010000:00010000:1.0:1789778180.902798:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 20 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778180.902814:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876160 00000100:00100000:1.0:1789778180.902816:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876160 00010000:00010000:1.0:1789778180.902824:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 21 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778180.902833:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876672 00000100:00100000:1.0:1789778180.902835:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876672 00010000:00010000:1.0:1789778180.902853:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 22 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778180.902862:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876288 00000100:00100000:1.0:1789778180.902864:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876288 00010000:00010000:1.0:1789778180.902873:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 23 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778180.902881:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876800 00000100:00100000:1.0:1789778180.902883:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876800 00010000:00010000:1.0:1789778180.902891:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 24 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778180.902900:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876416 00000100:00100000:1.0:1789778180.902902:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876416 00010000:00010000:1.0:1789778180.902908:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 25 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778180.902920:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789778180.902926:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+25:3312:x1876718314876544:12345-0@lo:103: 00010000:00010000:1.0:1789778180.902944:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778180.902949:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 25 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.902958:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 25 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.902973:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778180.903009:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+25:3312:x1876718314876544:12345-0@lo:103: Request processed in 83us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778180.903015:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789778180.903028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789778180.903033:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+24:3312:x1876718314876160:12345-0@lo:103: 00010000:00010000:1.0:1789778180.903039:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778180.903043:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 24 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903051:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 24 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903060:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440cb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440caf expref: 24 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903084:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778180.903101:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+23:3312:x1876718314876160:12345-0@lo:103: Request processed in 69us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778180.903107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789778180.903116:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789778180.903131:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+22:3312:x1876718314876672:12345-0@lo:103: 00010000:00010000:1.0:1789778180.903141:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778180.903145:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 22 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903153:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 22 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903161:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778180.903191:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+22:3312:x1876718314876672:12345-0@lo:103: Request processed in 48us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778180.903197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789778180.903207:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789778180.903212:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+21:3310:x1876718314876288:12345-0@lo:103: 00010000:00010000:1.0:1789778180.903218:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778180.903222:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 21 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903229:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 21 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903237:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778180.903482:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+21:3310:x1876718314876288:12345-0@lo:103: Request processed in 260us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778180.903489:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789778180.903500:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789778180.903506:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+20:3310:x1876718314876800:12345-0@lo:103: 00010000:00010000:1.0:1789778180.903512:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778180.903516:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 20 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903529:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 20 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903538:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778180.903556:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+20:3310:x1876718314876800:12345-0@lo:103: Request processed in 51us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778180.903561:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789778180.903571:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789778180.903576:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314876416:12345-0@lo:103: 00010000:00010000:1.0:1789778180.903582:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778180.903585:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 19 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903592:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 19 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.903600:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778180.903614:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314876416:12345-0@lo:103: Request processed in 39us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778180.903620:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789778180.903650:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314876416:0@lo:103: 00000100:00100000:1.0:1789778180.903658:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314876288:0@lo:103: 00000100:00100000:1.0:1789778180.903664:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314876800:0@lo:103: 00000100:00100000:1.0:1789778180.903692:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876160:0@lo:103: 00000100:00100000:1.0:1789778180.903699:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876672:0@lo:103: 00000100:00100000:1.0:1789778180.903712:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876544:0@lo:103: 00010000:00010000:0.0:1789778180.903903:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f3200/0x5a1e1c1157440c9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440c93 expref: 18 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.903915:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875392:0@lo:104: 00010000:00010000:0.0:1789778180.903924:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f2200/0x5a1e1c1157440c8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440c85 expref: 17 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.903932:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875520:0@lo:104: 00010000:00010000:0.0:1789778180.903940:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440c7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440c77 expref: 16 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.903947:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875648:0@lo:104: 00010000:00010000:0.0:1789778180.903955:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f3e00/0x5a1e1c1157440c54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440c4d expref: 15 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.903962:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875776:0@lo:104: 00010000:00010000:0.0:1789778180.903978:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95757c00/0x5a1e1c1157440c2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440c23 expref: 14 pid: 5840 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.903985:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875904:0@lo:104: 00010000:00010000:3.0:1789778180.906513:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778180.907118:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778180.908274:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314874880:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778180.908287:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1876718314875008:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778180.908328:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778180.908748:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295978112 00000100:00100000:3.0:1789778180.908754:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295978112 00010000:00010000:3.0:1789778180.908788:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 10 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778180.908822:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1789778180.908831:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718295978112:12345-192.168.201.45@tcp:103: 00010000:00010000:3.0:1789778180.908854:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778180.908860:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 10 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778180.908883:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 10 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778180.908901:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157440cee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a1e expref: 10 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778180.908916:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778180.908975:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14cc3ffd-125e-4ebe-b788-5465d0332197+9:2374:x1876718295978112:12345-192.168.201.45@tcp:103: Request processed in 144us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778180.908983:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1789778180.909795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778180.909901:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295977984 00000100:00100000:3.0:1789778180.909906:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295977984 00010000:00010000:3.0:1789778180.909925:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 9 pid: 5840 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778180.909949:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1789778180.909955:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14cc3ffd-125e-4ebe-b788-5465d0332197+9:2375:x1876718295977984:12345-192.168.201.45@tcp:103: 00010000:00010000:3.0:1789778180.909965:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778180.909969:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 9 pid: 5840 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778180.909979:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 9 pid: 5840 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778180.909990:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440cf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a25 expref: 9 pid: 5840 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778180.910013:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778180.910098:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14cc3ffd-125e-4ebe-b788-5465d0332197+8:2375:x1876718295977984:12345-192.168.201.45@tcp:103: Request processed in 142us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778180.910105:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00010000:00010000:2.0:1789778180.912017:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 13 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778180.912087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789778180.912099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:3312:x1876718314876032:12345-0@lo:103: 00010000:00010000:2.0:1789778180.912113:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778180.912118:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 13 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912582:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 13 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912599:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3d82321c00/0x5a1e1c1157440ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440cd9 expref: 13 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912616:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912625:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912642:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912649:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912667:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912672:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912678:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778180.912682:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912690:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912706:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778180.912717:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778180.912857:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:3312:x1876718314876032:12345-0@lo:103: Request processed in 761us (11050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778180.912865:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789778180.913175:0:8443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.913199:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778180.913206:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778180.921712:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314876032:0@lo:103: 00010000:00010000:2.0:1789778181.812208:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778181.898379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778181.898478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778181.898513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778181.898550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778181.898778:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295978624 00000100:00100000:0.0:1789778181.898787:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295978624 00000100:00100000:0.0:1789778181.898854:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295978496 00000100:00100000:0.0:1789778181.898857:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295978496 00000100:00100000:0.0:1789778181.898881:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:0.0:1789778181.898891:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295978624:12345-192.168.201.45@tcp:400: 00000100:00100000:0.0:1789778181.898955:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295978624:12345-192.168.201.45@tcp:400: Request processed in 67us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.898962:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:0.0:1789778181.898975:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1789778181.898981:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295978496:12345-192.168.201.45@tcp:400: 00000100:00100000:0.0:1789778181.898998:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295978496:12345-192.168.201.45@tcp:400: Request processed in 18us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.899004:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00080000:3.0:1789778181.899089:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789778181.899093:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778181.900307:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295978240 00000100:00100000:1.0:1789778181.900316:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295978240 00000100:00100000:1.0:1789778181.900368:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:1.0:1789778181.900376:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+8:2374:x1876718295978240:12345-192.168.201.45@tcp:400: 00000100:00100000:1.0:1789778181.900418:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+8:2374:x1876718295978240:12345-192.168.201.45@tcp:400: Request processed in 43us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778181.900426:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:2.0:1789778181.902017:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295978368 00000100:00100000:2.0:1789778181.902029:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295978368 00000100:00100000:2.0:1789778181.902181:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1789778181.902193:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295978368:12345-192.168.201.45@tcp:400: 00000100:00100000:2.0:1789778181.902272:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295978368:12345-192.168.201.45@tcp:400: Request processed in 82us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.902279:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00080000:3.0:1789778181.903020:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1789778181.937186:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789778181.937195:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3ebf7c9000 from 39 10000000:01000000:1.0:1789778181.937200:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789778181.937246:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.937274:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.937285:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778181.937306:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314876928:0@lo:101: 00000100:00100000:1.0:1789778181.937368:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.937426:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.939024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314876928 00000100:00100000:2.0:1789778181.939037:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314876928 00000100:00100000:2.0:1789778181.939117:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789778181.939128:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+12:5843:x1876718314876928:12345-0@lo:101: 00010000:00010000:2.0:1789778181.939144:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778181.939162:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657600/0x5a1e1c1157440d3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440d34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.939231:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657600/0x5a1e1c1157440d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440d34 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.939242:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657600/0x5a1e1c1157440d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440d34 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.939252:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657600, rc 0) 00000100:00100000:2.0:1789778181.939320:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314876928:12345-0@lo:101: Request processed in 194us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.939327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789778181.939416:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314876928:0@lo:101: 00010000:00010000:0.0:1789778181.939433:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.939442:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778181.939521:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877056:0@lo:501: 00000100:00100000:0.0:1789778181.939550:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.939583:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d6d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.939886:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877056 00000100:00100000:2.0:1789778181.939891:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877056 00000100:00100000:2.0:1789778181.939922:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789778181.939929:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314877056:12345-0@lo:501: 00000100:00100000:2.0:1789778181.940195:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314877056:12345-0@lo:501: Request processed in 266us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.940203:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789778181.940426:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877056:0@lo:501: 00000100:00100000:1.0:1789778181.940456:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877184:0@lo:503: 00000100:00100000:1.0:1789778181.940496:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.940522:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.940574:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877184 00000100:00100000:0.0:1789778181.940579:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877184 00000100:00100000:0.0:1789778181.940612:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789778181.940618:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314877184:12345-0@lo:503: 00000100:00100000:0.0:1789778181.940765:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314877184:12345-0@lo:503: Request processed in 146us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.940771:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789778181.940976:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877184:0@lo:503: 00000100:00100000:1.0:1789778181.941702:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8462:1876718314877312:0@lo:502: 00000100:00100000:1.0:1789778181.941763:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.941795:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.942055:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877312 00000100:00100000:2.0:1789778181.942061:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877312 00000100:00100000:2.0:1789778181.943267:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789778181.943292:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:8462:x1876718314877312:12345-0@lo:502: 00000100:00100000:2.0:1789778181.943547:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:8462:x1876718314877312:12345-0@lo:502: Request processed in 269us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.943555:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789778181.943656:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8462:1876718314877312:0@lo:502: 00000100:00100000:1.0:1789778181.943706:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8462:1876718314877440:0@lo:502: 00000100:00100000:1.0:1789778181.943742:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.946490:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789778181.946834:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877440 00000100:00100000:3.0:1789778181.946843:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877440 00000100:00100000:3.0:1789778181.946999:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789778181.947009:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:8462:x1876718314877440:12345-0@lo:502: 00000100:00100000:3.0:1789778181.947890:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:8462:x1876718314877440:12345-0@lo:502: Request processed in 880us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778181.947899:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789778181.952880:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8462:1876718314877440:0@lo:502: 00000040:00080000:1.0:1789778181.952938:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789778181.953407:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789778181.953431:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789778181.953443:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.953454:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778181.953465:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789778181.953467:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789778181.953470:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789778181.953510:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.953519:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.953528:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778181.953558:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877568:0@lo:101: 00000100:00100000:0.0:1789778181.953618:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.953654:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.953672:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877568 00000100:00100000:0.0:1789778181.953677:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877568 00000100:00100000:0.0:1789778181.953717:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789778181.953725:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+13:5843:x1876718314877568:12345-0@lo:101: 00010000:00010000:0.0:1789778181.953738:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778181.953750:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440d42 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.953772:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440d42 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.953781:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440d42 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.953790:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756200, rc 0) 00000100:00100000:0.0:1789778181.953833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314877568:12345-0@lo:101: Request processed in 98us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.953840:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789778181.953892:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877568:0@lo:101: 00010000:00010000:0.0:1789778181.953903:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.953911:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778181.953962:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877696:0@lo:501: 00000100:00100000:0.0:1789778181.953984:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.953998:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.954009:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877696 00000100:00100000:0.0:1789778181.954012:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877696 00000100:00100000:0.0:1789778181.954031:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789778181.954038:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314877696:12345-0@lo:501: 00000100:00100000:0.0:1789778181.954530:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314877696:12345-0@lo:501: Request processed in 491us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.954538:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789778181.954571:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877696:0@lo:501: 00000100:00100000:0.0:1789778181.954598:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877824:0@lo:503: 00000100:00100000:0.0:1789778181.954635:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.954648:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.954659:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877824 00000100:00100000:0.0:1789778181.954662:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877824 00000100:00100000:0.0:1789778181.954682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789778181.954687:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314877824:12345-0@lo:503: 00000100:00100000:0.0:1789778181.954838:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314877824:12345-0@lo:503: Request processed in 150us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.954844:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789778181.954878:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314877824:0@lo:503: 00000100:00100000:0.0:1789778181.955032:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8463:1876718314877952:0@lo:502: 00000100:00100000:0.0:1789778181.955082:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.955107:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314877952 00000100:00100000:0.0:1789778181.955111:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314877952 00000100:00100000:0.0:1789778181.955145:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789778181.955151:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:8463:x1876718314877952:12345-0@lo:502: 00000100:00100000:3.0:1789778181.955616:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd4780 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.955935:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:8463:x1876718314877952:12345-0@lo:502: Request processed in 782us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.955942:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789778181.956439:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8463:1876718314877952:0@lo:502: 00000020:01000000:3.0:1789778181.956466:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778181.956474:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778181.956477:0:8463:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789778181.956484:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789778181.956510:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8463:1876718314878080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778181.956544:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778181.956609:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.957759:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878080 00000100:00100000:0.0:1789778181.957769:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878080 00000100:00100000:0.0:1789778181.957935:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789778181.957944:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:8463:x1876718314878080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778181.958756:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:8463:x1876718314878080:12345-0@lo:502:llog_process_th.0 Request processed in 810us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.958765:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789778181.958884:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8463:1876718314878080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778181.958918:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778181.958925:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778181.958927:0:8463:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789778181.958934:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789778181.959205:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789778181.959239:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789778181.959249:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.959259:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778181.959269:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789778181.959271:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3ec0d89800 from 39 10000000:01000000:1.0:1789778181.959274:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789778181.959462:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.959471:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.959480:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778181.959498:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.959538:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.959831:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.960464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878208 00000100:00100000:2.0:1789778181.960472:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878208 00000100:00100000:2.0:1789778181.960510:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789778181.960518:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:5843:x1876718314878208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778181.960531:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778181.960545:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657a00/0x5a1e1c1157440d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440d50 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.960569:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657a00/0x5a1e1c1157440d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440d50 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.960580:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657a00/0x5a1e1c1157440d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440d50 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.960588:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657a00, rc 0) 00000100:00100000:2.0:1789778181.960733:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314878208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.960740:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789778181.961039:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789778181.961055:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.961096:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778181.961358:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.961398:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.961417:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.961462:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878336 00000100:00100000:2.0:1789778181.961466:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878336 00000100:00100000:2.0:1789778181.961483:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789778181.961490:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314878336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.961993:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314878336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 502us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.962001:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789778181.962272:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.962388:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.962425:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.962454:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.962498:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878464 00000100:00100000:2.0:1789778181.962503:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878464 00000100:00100000:2.0:1789778181.962532:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789778181.962539:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314878464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.962796:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314878464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.962803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789778181.963001:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.963568:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8464:1876718314878592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778181.963678:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.963708:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778181.963950:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878592 00000100:00100000:1.0:1789778181.963956:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878592 00000100:00100000:1.0:1789778181.964029:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789778181.964038:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:8464:x1876718314878592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778181.964524:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:8464:x1876718314878592:12345-0@lo:502:llog_process_th.0 Request processed in 487us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778181.964532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789778181.964710:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8464:1876718314878592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778181.964759:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8464:1876718314878720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778181.964794:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.964965:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90cd4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.965001:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878720 00000100:00100000:2.0:1789778181.965005:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878720 00000100:00100000:2.0:1789778181.965026:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789778181.965032:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:8464:x1876718314878720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778181.965471:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:8464:x1876718314878720:12345-0@lo:502:llog_process_th.0 Request processed in 437us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.965478:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789778181.965571:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8464:1876718314878720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789778181.965592:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789778181.965833:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789778181.965851:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789778181.965924:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.965936:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778181.965945:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789778181.965949:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789778181.965951:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789778181.965976:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.965992:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.966002:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778181.966017:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.966047:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.966440:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.966472:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878848 00000100:00100000:0.0:1789778181.966477:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878848 00000100:00100000:0.0:1789778181.966550:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789778181.966565:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:5843:x1876718314878848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778181.966575:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778181.966586:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440d5e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.966674:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440d5e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.966685:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440d5e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.966693:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756000, rc 0) 00000100:00100000:0.0:1789778181.966729:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314878848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.966735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789778181.966785:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789778181.966797:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.966806:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778181.966919:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.966945:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.967005:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.967060:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314878976 00000100:00100000:2.0:1789778181.967085:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314878976 00000100:00100000:2.0:1789778181.967104:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789778181.967110:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314878976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.967557:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314878976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.967565:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789778181.967689:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314878976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.967718:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.967756:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.967787:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.968368:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314879104 00000100:00100000:2.0:1789778181.968375:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314879104 00000100:00100000:2.0:1789778181.968398:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789778181.968405:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314879104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.968559:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314879104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.968572:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789778181.968695:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.968957:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8465:1876718314879232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778181.968995:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.969020:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.969060:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314879232 00000100:00100000:2.0:1789778181.969087:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314879232 00000100:00100000:2.0:1789778181.969105:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789778181.969111:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:8465:x1876718314879232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778181.969422:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:8465:x1876718314879232:12345-0@lo:502:llog_process_th.0 Request processed in 310us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.969429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789778181.969555:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8465:1876718314879232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789778181.969574:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778181.969583:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778181.969585:0:8465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789778181.969592:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789778181.969676:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8465:1876718314879360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778181.969705:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.969731:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.969789:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314879360 00000100:00100000:0.0:1789778181.969795:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314879360 00000100:00100000:0.0:1789778181.969818:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789778181.969834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:8465:x1876718314879360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778181.970087:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:8465:x1876718314879360:12345-0@lo:502:llog_process_th.0 Request processed in 253us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.970093:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789778181.970373:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8465:1876718314879360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789778181.970391:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778181.970395:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778181.970396:0:8465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789778181.970401:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789778181.970445:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789778181.970458:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789778181.970467:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.970478:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778181.970488:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789778181.970491:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3eabbad800 from 39 10000000:01000000:1.0:1789778181.970494:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789778181.970517:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.970534:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.970542:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778181.970556:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.970583:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.970673:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.970763:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314879488 00000100:00100000:0.0:1789778181.970767:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314879488 00000100:00100000:0.0:1789778181.970786:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789778181.970791:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314879488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778181.970800:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778181.970810:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756400/0x5a1e1c1157440d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440d6c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.970846:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756400/0x5a1e1c1157440d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440d6c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.970857:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756400/0x5a1e1c1157440d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440d6c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.970865:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756400, rc 0) 00000100:00100000:0.0:1789778181.970903:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314879488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.970909:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789778181.971052:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789778181.971099:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778181.971110:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778181.971379:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.971408:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.971429:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.971477:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314879616 00000100:00100000:0.0:1789778181.971481:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314879616 00000100:00100000:0.0:1789778181.971509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789778181.971515:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314879616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.973425:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314879616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1903us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.973437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789778181.973689:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.973737:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.973785:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778181.973854:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0367540 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.973891:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314879744 00000100:00100000:0.0:1789778181.973898:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314879744 00000100:00100000:0.0:1789778181.973967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789778181.973976:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314879744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.974380:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314879744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 404us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.974387:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789778181.974460:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314879744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.974862:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8466:1876718314879872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778181.974901:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778181.974995:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931600 going to sleep for 11 seconds 00000100:00100000:1.0:1789778181.975050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314879872 00000100:00100000:1.0:1789778181.975056:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314879872 00000100:00100000:1.0:1789778181.975106:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789778181.975114:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8466:x1876718314879872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778181.975471:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8466:x1876718314879872:12345-0@lo:502:llog_process_th.0 Request processed in 358us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778181.975476:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789778181.975548:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8466:1876718314879872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778181.975577:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8466:1876718314880000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778181.975652:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778181.975672:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931600 going to sleep for 11 seconds 00000100:00100000:1.0:1789778181.975791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880000 00000100:00100000:1.0:1789778181.975794:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880000 00000100:00100000:1.0:1789778181.975809:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789778181.975812:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8466:x1876718314880000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778181.975942:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8466:x1876718314880000:12345-0@lo:502:llog_process_th.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778181.975946:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789778181.975998:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8466:1876718314880000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789778181.976012:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789778181.976113:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789778181.976133:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789778181.976148:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.976158:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778181.976168:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789778181.976171:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789778181.976173:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789778181.976197:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.976205:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.976214:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778181.976228:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.976866:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.976899:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.976942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880128 00000100:00100000:2.0:1789778181.976956:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880128 00000100:00100000:2.0:1789778181.976990:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789778181.976997:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314880128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778181.977008:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778181.977020:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157440d81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440d7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.977042:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157440d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440d7a expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.977052:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157440d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440d7a expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.977061:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656200, rc 0) 00000100:00100000:2.0:1789778181.977412:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314880128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.977418:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789778181.977518:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778181.977533:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.977543:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778181.977614:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.977652:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.977742:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789778181.977781:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880256 00000100:00100000:3.0:1789778181.977787:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880256 00000100:00100000:3.0:1789778181.977818:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789778181.977836:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314880256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778181.978099:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314880256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778181.978106:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789778181.978372:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.978399:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.978436:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.978457:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.978790:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880384 00000100:00100000:2.0:1789778181.978794:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880384 00000100:00100000:2.0:1789778181.978837:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789778181.978844:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314880384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.978991:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314880384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.978998:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789778181.979449:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.979802:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8467:1876718314880512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778181.979861:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.979891:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778181.979944:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880512 00000100:00100000:2.0:1789778181.979951:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880512 00000100:00100000:2.0:1789778181.979986:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789778181.979994:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8467:x1876718314880512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778181.980851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8467:x1876718314880512:12345-0@lo:502:llog_process_th.0 Request processed in 855us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778181.980859:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789778181.980965:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8467:1876718314880512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789778181.980990:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778181.980998:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778181.981001:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789778181.981008:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789778181.981030:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8467:1876718314880640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778181.981103:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778181.981384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880640 00000100:00100000:1.0:1789778181.981391:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880640 00000100:00100000:1.0:1789778181.981427:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789778181.981435:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8467:x1876718314880640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778181.981588:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8467:x1876718314880640:12345-0@lo:502:llog_process_th.0 Request processed in 154us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778181.981682:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778181.981695:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8467:1876718314880640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789778181.981712:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778181.981716:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778181.981718:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789778181.981721:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:1.0:1789778181.982391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000020:01000000:2.0:1789778181.983344:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789778181.983369:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789778181.983380:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.983391:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778181.983402:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789778181.983404:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b3e85d019b8 from 1 10000000:01000000:2.0:1789778181.983407:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789778181.983441:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.983448:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778181.983457:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778181.983478:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789778181.983530:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778181.983570:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789778181.984957:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880768 00000100:00100000:3.0:1789778181.984968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880768 00000100:00100000:3.0:1789778181.985027:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789778181.985035:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314880768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778181.985051:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778181.985092:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150fa00/0x5a1e1c1157440d8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440d88 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778181.985128:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150fa00/0x5a1e1c1157440d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440d88 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778181.985139:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150fa00/0x5a1e1c1157440d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440d88 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778181.985148:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150fa00, rc 0) 00000100:00100000:3.0:1789778181.985219:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314880768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778181.985339:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789778181.985721:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778181.985739:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.985756:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778181.987273:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778181.987342:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778181.987371:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778181.987472:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314880896 00000100:00100000:1.0:1789778181.987479:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314880896 00000100:00100000:1.0:1789778181.987519:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789778181.987527:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314880896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778181.987796:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314880896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (454us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789778181.987804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789778181.988791:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314880896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789778181.988834:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789778181.988844:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778181.988855:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778182.068244:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314881024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778182.068310:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778182.068532:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314881024 00000100:00100000:2.0:1789778182.068540:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314881024 00000100:00100000:2.0:1789778182.068611:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789778182.068636:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314881024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778182.068675:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778182.068688:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314881408:0@lo:400:kworker.0 00000100:00100000:1.0:1789778182.068731:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778182.068732:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314881024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778182.068742:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789778182.068755:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778182.068763:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314881536:0@lo:400:kworker.0 00000100:00100000:2.0:1789778182.068772:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314881280:0@lo:400:kworker.0 00000100:00100000:1.0:1789778182.068786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789778182.068844:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778182.068931:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314881152:0@lo:400:kworker.0 00000100:00100000:2.0:1789778182.069884:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778182.069948:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314881408 00000100:00100000:3.0:1789778182.069955:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314881408 00000100:00100000:3.0:1789778182.069993:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314881536 00000100:00100000:3.0:1789778182.069996:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314881536 00000100:00100000:3.0:1789778182.070008:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314881280 00000100:00100000:3.0:1789778182.070010:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314881280 00000100:00100000:3.0:1789778182.070022:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789778182.070029:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314881408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778182.070097:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789778182.070102:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314881408:12345-0@lo:400:kworker.0 Request processed in 71us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778182.070110:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314881536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778182.070115:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789778182.070136:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789778182.070146:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314881280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778182.070157:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314881536:12345-0@lo:400:kworker.0 Request processed in 50us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778182.070185:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314881280:12345-0@lo:400:kworker.0 Request processed in 42us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778182.070384:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789778182.070431:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314881280:0@lo:400:kworker.0 00000100:00100000:1.0:1789778182.071105:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314881536:0@lo:400:kworker.0 00000100:00100000:1.0:1789778182.071119:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314881408:0@lo:400:kworker.0 00000100:00080000:2.0:1789778182.071124:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778182.071226:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778182.071271:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314881664:0@lo:400:kworker.0 00000100:00100000:0.0:1789778182.071320:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778182.071505:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314881664 00000100:00100000:1.0:1789778182.071512:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314881664 00000100:00100000:1.0:1789778182.071566:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789778182.071575:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314881664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778182.071613:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314881664:12345-0@lo:400:kworker.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778182.071619:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789778182.071634:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789778182.071717:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec0d7a300 x1876718314881664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778182.071727:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314881664:0@lo:400:kworker.0 00010000:00080000:0.0:1789778182.071763:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98616680 x1876718314881024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778182.071789:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314881024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778182.072135:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314881152 00000100:00100000:2.0:1789778182.072140:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314881152 00000100:00100000:2.0:1789778182.072172:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789778182.072179:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314881152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778182.072444:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314881152:12345-0@lo:400:kworker.0 Request processed in 266us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778182.072451:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789778182.072522:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314881152:0@lo:400:kworker.0 00000100:00100000:3.0:1789778182.072599:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789778182.577740:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778182.577802:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314881792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778182.577909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778182.578023:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314881792 00000100:00100000:2.0:1789778182.578043:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314881792 00000100:00100000:2.0:1789778182.578170:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789778182.578181:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314881792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778182.578655:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778182.578716:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314881792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 536us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778182.578724:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789778182.578803:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98617100 x1876718314881792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778182.578832:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314881792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778182.602713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778182.602777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295978752 00000100:00100000:2.0:1789778182.602787:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295978752 00000100:00100000:2.0:1789778182.602863:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:2.0:1789778182.602873:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+8:5629:x1876718295978752:12345-192.168.201.45@tcp:101: 00010000:00010000:2.0:1789778182.602889:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778182.602906:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81656600/0x5a1e1c1157440d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778182.602934:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656600/0x5a1e1c1157440d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a87 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778182.602946:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81656600/0x5a1e1c1157440d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a87 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778182.602956:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656600, rc 0) 00000100:00100000:2.0:1789778182.603020:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5629:x1876718295978752:12345-192.168.201.45@tcp:101: Request processed in 148us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778182.603028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:1.0:1789778182.610667:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778182.610872:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295978880 00000100:00100000:2.0:1789778182.610884:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295978880 00000100:00100000:2.0:1789778182.610953:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:2.0:1789778182.610965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5629:x1876718295978880:12345-192.168.201.45@tcp:501: 00000100:00100000:3.0:1789778182.623479:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5629:x1876718295978880:12345-192.168.201.45@tcp:501: Request processed in 12507us (12814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778182.623490:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:3.0:1789778182.630448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778182.630534:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979008 00000100:00100000:1.0:1789778182.630542:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979008 00000100:00100000:1.0:1789778182.630598:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:1.0:1789778182.630607:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5629:x1876718295979008:12345-192.168.201.45@tcp:503: 00000100:00100000:1.0:1789778182.630785:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5629:x1876718295979008:12345-192.168.201.45@tcp:503: Request processed in 178us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778182.630793:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:1.0:1789778182.650711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778182.650841:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979136 00000100:00100000:3.0:1789778182.650853:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979136 00000100:00100000:3.0:1789778182.650918:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:3.0:1789778182.650928:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+9:6102:x1876718295979136:12345-192.168.201.45@tcp:502: 00000100:00100000:3.0:1789778182.651498:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+9:6102:x1876718295979136:12345-192.168.201.45@tcp:502: Request processed in 568us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778182.651506:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:2.0:1789778182.657395:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778182.657551:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979264 00000100:00100000:3.0:1789778182.657561:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979264 00000100:00100000:3.0:1789778182.657669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:3.0:1789778182.657680:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+9:6102:x1876718295979264:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789778182.657953:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+9:6102:x1876718295979264:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 275us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778182.657970:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:1.0:1789778182.675377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778182.675988:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979392 00000100:00100000:3.0:1789778182.675999:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979392 00000100:00100000:3.0:1789778182.676056:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:3.0:1789778182.676106:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5629:x1876718295979392:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778182.676564:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778182.676584:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778182.676612:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a8e expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778182.676624:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a8e expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778182.676632:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150fc00, rc 0) 00000100:00100000:3.0:1789778182.676692:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295979392:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 628us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778182.676713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:2.0:1789778182.678913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778182.679777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979520 00000100:00100000:3.0:1789778182.679788:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979520 00000100:00100000:3.0:1789778182.679859:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:3.0:1789778182.679869:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295979520:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778182.681671:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295979520:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 1789us (2751us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789778182.681684:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 171 00010000:00010000:3.0:1789778182.833215:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778183.857716:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789778184.350740:0:8505:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc89244960 20000000:00000080:0.0:1789778184.350758:0:8505:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3ec16fec00 uarg=0000000000000000 20000000:01000000:0.0:1789778184.350806:0:8505:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789778184.350812:0:8505:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789778184.350817:0:8505:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789778184.352116:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789778184.352268:0:8505:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789778184.355459:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789778184.355521:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789778184.355574:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789778184.355594:0:8505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789778184.355615:0:8505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778184.355634:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778184.355642:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778184.355650:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778184.355659:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778184.355666:0:8505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778184.355709:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778184.355727:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 9 pid: 5841 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778184.355741:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314881920:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778184.363439:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.363460:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 18 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.363477:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314882048:0@lo:104: 00000100:00100000:3.0:1789778184.363534:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778184.363582:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.363591:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 18 pid: 5839 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.363600:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314882176:0@lo:104: 00000100:00100000:3.0:1789778184.363625:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778184.363657:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.363684:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 18 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.363693:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314882304:0@lo:104: 00000100:00100000:3.0:1789778184.363713:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0bb0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789778184.363762:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789778184.363790:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778184.363803:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882048 00000100:00100000:1.0:1789778184.363810:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882048 00000100:00100000:1.0:1789778184.363848:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882176 00000100:00100000:1.0:1789778184.363851:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882176 00000100:00100000:1.0:1789778184.363870:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882304 00000100:00100000:1.0:1789778184.363873:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882304 00000100:00100000:1.0:1789778184.363886:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789778184.363894:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:8505:x1876718314882048:12345-0@lo:104: 00010000:00010000:1.0:1789778184.363906:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.363985:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789778184.363991:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:8505:x1876718314882048:12345-0@lo:104: Request processed in 98us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778184.364337:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314882048:0@lo:104: 00000100:00100000:1.0:1789778184.369222:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789778184.369262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789778184.369282:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:8505:x1876718314882176:12345-0@lo:104: 00010000:00010000:1.0:1789778184.369312:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.369591:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789778184.369598:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:8505:x1876718314882176:12345-0@lo:104: Request processed in 328us (5971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778184.369605:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789778184.369640:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314882176:0@lo:104: 00000100:00100000:1.0:1789778184.369640:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789778184.369646:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:8505:x1876718314882304:12345-0@lo:104: 00010000:00010000:1.0:1789778184.369653:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.369823:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789778184.369829:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:8505:x1876718314882304:12345-0@lo:104: Request processed in 184us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778184.369849:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314882304:0@lo:104: 00000100:00100000:1.0:1789778184.369852:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789778184.369871:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789778184.369877:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.369884:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f600 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778184.369888:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.369896:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778184.369903:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778184.369908:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789778184.369952:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370088:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778184.370111:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370117:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f600/0x5a1e1c1157440c3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440c46 expref: -99 pid: 7622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370121:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314882432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778184.370131:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778184.370135:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370150:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778184.370153:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370159:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778184.370165:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370166:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789778184.370170:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789778184.370186:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370192:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778184.370198:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370200:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789778184.370204:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440beb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370205:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314882560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778184.370213:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778184.370216:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370222:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756e00 already unused, calling callback (ffffffffc1b43c20) 00000100:00100000:3.0:1789778184.370223:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789778184.370225:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370241:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370246:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882432 10000000:00010000:1.0:1789778184.370247:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370251:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882432 10000000:01000000:1.0:1789778184.370252:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789778184.370263:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370269:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789778184.370273:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 19 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.370282:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370291:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882560 00000100:00100000:3.0:1789778184.370294:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882560 00010000:00010000:1.0:1789778184.370301:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440b6d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370304:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 20 pid: 5839 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370315:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789778184.370316:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778184.370317:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778184.370319:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778184.370320:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+20:3310:x1876718314882432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789778184.370329:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789778184.370331:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314882688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789778184.370339:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 20 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370348:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 20 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778184.370353:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778184.370361:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f3000/0x5a1e1c1157440c46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440c3f expref: 20 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370374:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778184.370403:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314882432:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778184.370410:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789778184.370421:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882688 00000100:00100000:3.0:1789778184.370433:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882688 00010000:00010000:3.0:1789778184.370444:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 19 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778184.370455:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789778184.370461:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314882560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789778184.370467:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778184.370470:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 19 pid: 5839 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370478:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 19 pid: 5839 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370487:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440beb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440bdd expref: 19 pid: 5839 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370496:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778184.370523:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:3310:x1876718314882560:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778184.370529:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789778184.370541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789778184.370547:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:3312:x1876718314882688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789778184.370553:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778184.370557:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 17 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370564:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 17 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370574:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440b66 expref: 17 pid: 5840 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778184.370582:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778184.370604:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3312:x1876718314882688:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778184.370610:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778184.370663:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314882688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778184.370767:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314882560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778184.370775:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314882432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789778184.371312:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778184.372378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778184.372478:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1876718314881920:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778184.372512:0:8505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778184.372644:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979648 00000100:00100000:1.0:1789778184.372661:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979648 00010000:00010000:1.0:1789778184.372688:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 10 pid: 5841 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778184.372720:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:1.0:1789778184.372728:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2375:x1876718295979648:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778184.372739:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778184.372744:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 10 pid: 5841 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372889:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 10 pid: 5841 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372904:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150f000/0x5a1e1c1157440d03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a56 expref: 10 pid: 5841 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372920:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372928:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372943:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372951:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372957:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372973:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372980:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778184.372983:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.372991:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.373011:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778184.373020:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789778184.373296:0:8505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778184.373305:0:8505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778184.373312:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657c00/0x5a1e1c1157440da4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778184.374279:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+9:2375:x1876718295979648:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1331us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778184.374293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00010000:00010000:1.0:1789778184.898205:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789778185.461157:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789778185.461168:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ebf7c9000 from 4 10000000:01000000:1.0:1789778185.461174:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789778185.461223:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778185.461236:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778185.461248:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778185.461282:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314882816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789778185.461350:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778185.461424:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957da3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778185.466157:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882816 00000100:00100000:2.0:1789778185.466171:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882816 00000100:00100000:2.0:1789778185.466224:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789778185.466234:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314882816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778185.466262:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778185.466284:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440dab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778185.466311:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778185.466323:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778185.466332:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657400, rc 0) 00000100:00100000:2.0:1789778185.466412:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314882816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778185.466420:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789778185.466473:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314882816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778185.466489:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778185.466499:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778185.466561:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314882944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.466590:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778185.466618:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778185.466637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314882944 00000100:00100000:2.0:1789778185.466641:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314882944 00000100:00100000:2.0:1789778185.466662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789778185.466668:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314882944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.466899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314882944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778185.466905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789778185.466931:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314882944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.466953:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.466985:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778185.466995:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778185.467005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883072 00000100:00100000:2.0:1789778185.467007:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883072 00000100:00100000:2.0:1789778185.467023:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789778185.467029:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314883072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.467185:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314883072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778185.467192:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789778185.470931:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.473549:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8543:1876718314883200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778185.473623:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778185.473665:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658180 going to sleep for 11 seconds 00000100:00100000:3.0:1789778185.473708:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883200 00000100:00100000:3.0:1789778185.473716:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883200 00000100:00100000:3.0:1789778185.473772:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789778185.473781:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8543:x1876718314883200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778185.474002:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8543:x1876718314883200:12345-0@lo:502:llog_process_th.0 Request processed in 221us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778185.474010:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789778185.474110:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8543:1876718314883200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789778185.474139:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778185.474148:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778185.474151:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789778185.474158:0:8543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ebf7c9000 00000020:00000080:0.0:1789778185.474161:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789778185.474232:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8543:1876718314883328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778185.474279:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778185.474302:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883328 00000100:00100000:0.0:1789778185.474306:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883328 00000100:00100000:0.0:1789778185.474327:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789778185.474333:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8543:x1876718314883328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778185.474438:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:8543:x1876718314883328:12345-0@lo:502:llog_process_th.0 Request processed in 104us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778185.474446:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789778185.474476:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e87637240 going to sleep for 11 seconds 00000100:00100000:0.0:1789778185.474486:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8543:1876718314883328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789778185.474501:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778185.474504:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778185.474506:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789778185.474509:0:8543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789778185.478001:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789778185.478043:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778185.478056:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.481016:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778185.481031:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789778185.481034:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ec0d89800 from 4 10000000:01000000:3.0:1789778185.481038:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789778185.481095:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.481104:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.481115:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778185.481140:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.481205:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.481248:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789778185.486516:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883456 00000100:00100000:2.0:1789778185.486530:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883456 00000100:00100000:2.0:1789778185.486581:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789778185.486591:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314883456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778185.486607:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778185.486630:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440db9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778185.486659:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778185.486671:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778185.486680:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656800, rc 0) 00000100:00100000:3.0:1789778185.490424:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778185.490456:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.490469:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778185.490556:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.490655:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314883456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4064us (9447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778185.490665:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789778185.490910:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.490950:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789778185.491196:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883584 00000100:00100000:2.0:1789778185.491204:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883584 00000100:00100000:0.0:1789778185.507405:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789778185.507423:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314883584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778185.507708:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314883584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (16797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778185.507723:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789778185.509502:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.509563:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.509629:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.509669:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789778185.511866:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883712 00000100:00100000:2.0:1789778185.511885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883712 00000100:00100000:2.0:1789778185.511937:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789778185.511947:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314883712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.512233:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314883712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 287us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778185.512241:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789778185.514905:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314883712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.527264:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8549:1876718314883840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778185.527346:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.527384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883840 00000100:00100000:3.0:1789778185.527390:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883840 00000100:00100000:3.0:1789778185.527435:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789778185.527443:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8549:x1876718314883840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778185.527634:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8549:x1876718314883840:12345-0@lo:502:llog_process_th.0 Request processed in 190us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778185.527641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789778185.527689:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789778185.527709:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8549:1876718314883840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778185.527737:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778185.527746:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778185.527748:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789778185.527755:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ec0d89800 00000020:00000080:3.0:1789778185.527768:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789778185.529449:0:8549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8549:1876718314883968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778185.529514:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.529546:0:8549:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9549c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778185.529706:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314883968 00000100:00100000:0.0:1789778185.529713:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314883968 00000100:00100000:0.0:1789778185.529767:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789778185.529777:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8549:x1876718314883968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778185.529955:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:8549:x1876718314883968:12345-0@lo:502:llog_process_th.0 Request processed in 179us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778185.529962:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789778185.533422:0:8549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8549:1876718314883968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778185.533472:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778185.533483:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778185.533485:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789778185.533490:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789778185.533571:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789778185.533589:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778185.533600:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.533611:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778185.533623:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789778185.533625:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3eabbad800 from 4 10000000:01000000:3.0:1789778185.533628:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789778185.533659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.533667:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.533676:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778185.533696:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314884096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.533754:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.543142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884096 00000100:00100000:3.0:1789778185.543159:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884096 00000100:00100000:3.0:1789778185.543229:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789778185.543238:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314884096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778185.543269:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778185.543287:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440dc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.543315:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.543326:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.543335:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f600, rc 0) 00000100:00100000:3.0:1789778185.543389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314884096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (9635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778185.543396:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789778185.543446:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9549c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789778185.543469:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314884096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778185.543486:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.543494:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778185.543562:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314884224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.543592:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.543611:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884224 00000100:00100000:3.0:1789778185.543615:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884224 00000100:00100000:3.0:1789778185.543642:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789778185.543648:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314884224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.543884:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314884224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778185.543891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789778185.543912:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9549c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789778185.543922:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314884224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.543947:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314884352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.543982:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.543999:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884352 00000100:00100000:3.0:1789778185.544002:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884352 00000100:00100000:3.0:1789778185.544022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789778185.544028:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314884352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778185.544177:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314884352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778185.544184:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789778185.544209:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9549c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789778185.544221:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314884352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778185.550248:0:8552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8552:1876718314884480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778185.550497:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778185.550544:0:8552:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658180 going to sleep for 11 seconds 00000100:00100000:3.0:1789778185.550596:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884480 00000100:00100000:3.0:1789778185.550603:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884480 00000100:00100000:3.0:1789778185.550656:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789778185.550664:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:8552:x1876718314884480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778185.550888:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:8552:x1876718314884480:12345-0@lo:502:llog_process_th.0 Request processed in 223us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778185.550896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789778185.550955:0:8552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8552:1876718314884480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778185.550985:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778185.550994:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778185.550997:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789778185.551003:0:8552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3eabbad800 00000020:00000080:3.0:1789778185.551006:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789778185.551529:0:8552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8552:1876718314884608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778185.551565:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778185.551587:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884608 00000100:00100000:3.0:1789778185.551591:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884608 00000100:00100000:3.0:1789778185.551615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789778185.551622:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:8552:x1876718314884608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778185.551745:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:8552:x1876718314884608:12345-0@lo:502:llog_process_th.0 Request processed in 123us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778185.551752:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789778185.551795:0:8552:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789778185.551808:0:8552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:8552:1876718314884608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778185.551825:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778185.551830:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778185.551831:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789778185.551834:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789778185.551939:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789778185.551956:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778185.551965:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778185.551976:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778185.905347:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778186.058510:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778186.059174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979776 00000100:00100000:3.0:1789778186.059185:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979776 00000100:00100000:3.0:1789778186.059248:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:3.0:1789778186.059266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+9:5629:x1876718295979776:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778186.059284:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778186.059302:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a95 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778186.059386:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778186.059409:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778186.059419:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f800, rc 0) 00000100:00100000:0.0:1789778186.059486:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295979776:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 221us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778186.059492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:2.0:1789778186.062306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778186.062623:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295979904 00000100:00100000:3.0:1789778186.062645:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295979904 00000100:00100000:3.0:1789778186.062698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:3.0:1789778186.062707:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295979904:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778186.063770:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295979904:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 1059us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778186.063780:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:3.0:1789778186.077448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778186.077539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980032 00000100:00100000:0.0:1789778186.077551:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980032 00000100:00100000:0.0:1789778186.077609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:0.0:1789778186.077619:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295980032:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778186.077951:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:5629:x1876718295980032:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 332us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778186.077959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:3.0:1789778186.081330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778186.081426:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980160 00000100:00100000:2.0:1789778186.081436:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980160 00000100:00100000:2.0:1789778186.081490:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:2.0:1789778186.081514:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:6165:x1876718295980160:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789778186.081791:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:6165:x1876718295980160:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 278us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778186.081803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:2.0:1789778186.088926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778186.089379:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980288 00000100:00100000:3.0:1789778186.089398:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980288 00000100:00100000:3.0:1789778186.089456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:3.0:1789778186.089466:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:6165:x1876718295980288:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789778186.089723:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:6165:x1876718295980288:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 257us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778186.089731:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 191 00010000:00010000:1.0:1789778186.929505:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778187.019837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778187.019879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778187.019913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778187.019949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778187.019982:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980672 00000100:00100000:0.0:1789778187.019992:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980672 00000100:00100000:0.0:1789778187.020045:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980800 00000100:00100000:0.0:1789778187.020049:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980800 00000100:00100000:0.0:1789778187.020106:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:0.0:1789778187.020116:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295980672:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778187.020228:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1789778187.020239:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295980800:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778187.020301:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295980800:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 64us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778187.020308:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1789778187.020534:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980416 00000100:00100000:3.0:1789778187.020552:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980416 00000100:00100000:3.0:1789778187.020587:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:3.0:1789778187.020595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295980416:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778187.020630:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295980416:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 36us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778187.020636:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:1.0:1789778187.020805:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980544 00000100:00100000:1.0:1789778187.020809:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980544 00000100:00100000:1.0:1789778187.020853:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:1.0:1789778187.020860:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295980544:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778187.020898:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295980544:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 40us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778187.020904:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00080000:1.0:1789778187.020923:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789778187.020926:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789778187.020928:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778187.021021:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295980672:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 907us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778187.021029:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778187.185396:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314884992:0@lo:400:kworker.0 00000100:00100000:3.0:1789778187.185471:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778187.185532:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789778187.185538:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314884864:0@lo:400:kworker.0 00000100:00100000:3.0:1789778187.185561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778187.185578:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314885376:0@lo:400:kworker.0 00000100:00100000:3.0:1789778187.185602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778187.185638:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884992 00000100:00100000:3.0:1789778187.185646:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884992 00000100:00100000:3.0:1789778187.185692:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884864 00000100:00100000:3.0:1789778187.185695:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884864 00000100:00100000:3.0:1789778187.185712:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789778187.185720:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314884992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778187.185801:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314884992:12345-0@lo:400:kworker.0 Request processed in 81us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778187.185809:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789778187.185828:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789778187.185835:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314884864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778187.185861:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314884864:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778187.185884:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789778187.185921:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314884864:0@lo:400:kworker.0 00000100:00100000:3.0:1789778187.185931:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314884992:0@lo:400:kworker.0 00000100:00100000:1.0:1789778187.186033:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314884736:0@lo:400:kworker.0 00000100:00100000:1.0:1789778187.186088:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778187.186111:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314885248:0@lo:400:kworker.0 00000100:00100000:1.0:1789778187.186133:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778187.186151:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789778187.186156:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314885120:0@lo:400:kworker.0 00000100:00100000:1.0:1789778187.186178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778187.186200:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314884736 00000100:00100000:1.0:1789778187.186209:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314884736 00000100:00100000:1.0:1789778187.186233:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789778187.186239:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314884736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778187.186271:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314884736:12345-0@lo:400:kworker.0 Request processed in 33us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778187.186278:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1789778187.186302:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778187.186311:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314885248 00000100:00100000:1.0:1789778187.186315:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314885248 00000100:00100000:1.0:1789778187.186337:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789778187.186343:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314885248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778187.186370:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314885248:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778187.186376:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789778187.186388:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778187.186401:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314884736:0@lo:400:kworker.0 00000100:00100000:1.0:1789778187.186410:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314885248:0@lo:400:kworker.0 00000100:00100000:2.0:1789778187.186510:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314885376 00000100:00100000:2.0:1789778187.186514:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314885376 00000100:00100000:2.0:1789778187.186555:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314885120 00000100:00100000:2.0:1789778187.186558:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314885120 00000100:00100000:2.0:1789778187.186576:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789778187.186582:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314885376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778187.186617:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314885376:12345-0@lo:400:kworker.0 Request processed in 35us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778187.186623:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789778187.186636:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789778187.186641:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314885120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778187.186669:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314885120:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778187.186675:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789778187.186707:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e987e4a80 x1876718314885120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778187.186724:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314885120:0@lo:400:kworker.0 00010000:00080000:3.0:1789778187.187566:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e987e7100 x1876718314885376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778187.187577:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314885376:0@lo:400:kworker.0 00000100:00080000:1.0:1789778187.187708:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789778187.187712:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778187.189085:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778187.189101:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314885504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778187.189172:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778187.189305:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314885504 00000100:00100000:0.0:1789778187.189314:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314885504 00000100:00100000:0.0:1789778187.189365:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789778187.189374:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314885504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778187.189408:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778187.189458:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314885504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778187.189466:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789778187.189577:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98617100 x1876718314885504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778187.189594:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314885504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778187.699287:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778187.699311:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314885632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778187.699390:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778187.699710:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314885632 00000100:00100000:0.0:1789778187.699727:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314885632 00000100:00100000:0.0:1789778187.699783:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789778187.699793:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314885632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778187.699827:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778187.699877:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314885632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778187.699898:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789778187.699938:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98616680 x1876718314885632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778187.699960:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314885632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778187.957232:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778188.984097:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778190.003188:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789778190.280683:0:8805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789778191.027088:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778192.050200:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778192.151661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778192.151718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778192.151747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778192.151772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778192.151809:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981184 00000100:00100000:2.0:1789778192.151819:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981184 00000100:00100000:2.0:1789778192.151877:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981312 00000100:00100000:2.0:1789778192.151880:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981312 00000100:00100000:2.0:1789778192.151906:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1789778192.151916:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295981184:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778192.152192:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295981184:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 276us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778192.152200:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1789778192.152218:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1789778192.152224:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295981312:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778192.152250:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295981312:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778192.152286:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981056 00000100:00100000:1.0:1789778192.152293:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981056 00000100:00100000:2.0:1789778192.152320:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1789778192.152330:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1789778192.152340:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295981056:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778192.152376:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295981056:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778192.152383:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00080000:1.0:1789778192.152402:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789778192.152407:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789778192.152409:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789778192.152424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295980928 00000100:00100000:3.0:1789778192.152430:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295980928 00000100:00100000:3.0:1789778192.152474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:3.0:1789778192.152483:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718295980928:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778192.152513:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718295980928:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 32us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778192.152520:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:3.0:1789778192.305548:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314885888:0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.305582:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314885760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778192.305654:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314886144:0@lo:400:kworker.0 00000100:00100000:2.0:1789778192.305709:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314886016:0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.309917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778192.310004:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314886272:0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.310054:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778192.310142:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314885760 00000100:00100000:0.0:1789778192.310150:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314885760 00000100:00100000:0.0:1789778192.310199:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789778192.310207:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314885760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778192.310242:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778192.310295:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314885760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778192.310302:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789778192.310324:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886272 00000100:00100000:0.0:1789778192.310327:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886272 00000100:00100000:0.0:1789778192.310348:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789778192.310353:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314886272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.310383:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314886272:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778192.310388:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789778192.310401:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789778192.314194:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98617480 x1876718314885760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778192.314241:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314885760:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789778192.314257:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98615180 x1876718314886272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778192.314265:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314886272:0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.314567:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778192.314661:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886144 00000100:00100000:1.0:1789778192.314669:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886144 00000100:00100000:1.0:1789778192.314731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789778192.314740:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314886144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778192.314796:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314886144:12345-0@lo:400:kworker.0 Request processed in 56us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778192.314803:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789778192.314836:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314886144:0@lo:400:kworker.0 00000100:00080000:0.0:1789778192.314855:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778192.315340:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778192.315386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778192.315419:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314886400:0@lo:400:kworker.0 00000100:00100000:3.0:1789778192.315447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778192.315485:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886016 00000100:00100000:3.0:1789778192.315489:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886016 00000100:00100000:2.0:1789778192.315504:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886400 00000100:00100000:2.0:1789778192.315509:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886400 00000100:00100000:3.0:1789778192.315516:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789778192.315523:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314886016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778192.315555:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778192.315556:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314886016:12345-0@lo:400:kworker.0 Request processed in 34us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778192.315562:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314886400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778192.315575:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789778192.315595:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314886400:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778192.315601:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778192.315606:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314886400:0@lo:400:kworker.0 00000100:00080000:2.0:1789778192.315616:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778192.315838:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314886016:0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.315847:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314886528:0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.315875:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778192.315973:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886528 00000100:00100000:2.0:1789778192.315977:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886528 00000100:00100000:2.0:1789778192.316025:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789778192.316033:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314886528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778192.316094:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314886528:12345-0@lo:400:kworker.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778192.316101:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789778192.316127:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98616680 x1876718314886528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778192.316138:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314886528:0@lo:400:kworker.0 00000100:00080000:0.0:1789778192.316203:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778192.321915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314885888 00000100:00100000:1.0:1789778192.321930:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314885888 00000100:00100000:0.0:1789778192.324332:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789778192.324346:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314885888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778192.324462:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314885888:12345-0@lo:400:kworker.0 Request processed in 119us (9122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778192.324471:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789778192.324524:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314885888:0@lo:400:kworker.0 00000100:00100000:1.0:1789778192.832828:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314886656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778192.832904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778192.833058:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886656 00000100:00100000:0.0:1789778192.833083:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886656 00000100:00100000:0.0:1789778192.833140:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789778192.833150:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314886656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778192.833185:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778192.833232:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314886656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778192.833240:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789778192.833343:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfb67480 x1876718314886656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778192.833376:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314886656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778193.073411:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778194.102919:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778195.121312:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778196.145308:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789778196.391582:0:9049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing yml_node 00010000:00010000:2.0:1789778197.173429:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778197.263817:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778197.263859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778197.263945:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981440 00000100:00100000:1.0:1789778197.263956:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981440 00000100:00100000:1.0:1789778197.264009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:1.0:1789778197.264018:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718295981440:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778197.264137:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718295981440:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778197.264143:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:2.0:1789778197.274846:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981568 00000100:00100000:2.0:1789778197.274862:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981568 00000100:00100000:2.0:1789778197.274935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:2.0:1789778197.274948:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295981568:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778197.275031:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295981568:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 87us (11170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778197.275048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00080000:0.0:1789778197.275786:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778197.276139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778197.276180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778197.276243:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981696 00000100:00100000:3.0:1789778197.276252:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981696 00000100:00100000:3.0:1789778197.276293:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981824 00000100:00100000:3.0:1789778197.276296:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981824 00000100:00100000:3.0:1789778197.276317:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1789778197.276326:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2371:x1876718295981696:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:3.0:1789778197.276366:0:8205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440d11 00000100:00080000:3.0:1789778197.276376:0:8205:0:(import.c:65:import_set_state_nolock()) ffff9b3d82bc3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789778197.276419:0:8205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789778197.276782:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+2:2371:x1876718295981696:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 457us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778197.276790:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1789778197.276803:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1789778197.276810:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2371:x1876718295981824:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:3.0:1789778197.276823:0:8205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440d18 00000100:00080000:3.0:1789778197.276829:0:8205:0:(import.c:65:import_set_state_nolock()) ffff9b3eb5811800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789778197.276847:0:8205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789778197.277018:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+2:2371:x1876718295981824:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 207us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778197.277024:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00010000:00010000:3.0:1789778197.277129:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789778197.277476:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778197.277480:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789778197.277537:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778197.429154:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778197.429178:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314886784:0@lo:400:kworker.0 00000100:00100000:1.0:1789778197.429246:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778197.429336:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314886912:0@lo:400:kworker.0 00000100:00100000:1.0:1789778197.429363:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778197.429398:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778197.429403:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314887040:0@lo:400:kworker.0 00000100:00100000:1.0:1789778197.429422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778197.429453:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314887168:0@lo:400:kworker.0 00000100:00100000:1.0:1789778197.429476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778197.429505:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887168 00000100:00100000:1.0:1789778197.429511:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887168 00000100:00100000:0.0:1789778197.429640:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886784 00000100:00100000:0.0:1789778197.429644:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886784 00000100:00100000:0.0:1789778197.429686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789778197.429695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314886784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778197.429751:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314886784:12345-0@lo:400:kworker.0 Request processed in 57us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778197.429758:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789778197.429804:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314886784:0@lo:400:kworker.0 00000100:00100000:1.0:1789778197.429936:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778197.429943:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314887168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778197.429989:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314887168:12345-0@lo:400:kworker.0 Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778197.429995:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778197.430043:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314887424:0@lo:400:kworker.0 00000100:00100000:1.0:1789778197.430097:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789778197.430195:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778197.430206:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314887296:0@lo:400:kworker.0 00000100:00100000:0.0:1789778197.430233:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778197.430260:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887424 00000100:00100000:0.0:1789778197.430264:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887424 00000100:00100000:0.0:1789778197.430293:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789778197.430300:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314887424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778197.430334:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314887424:12345-0@lo:400:kworker.0 Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778197.430340:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789778197.430353:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789778197.430375:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f5880 x1876718314887168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778197.430387:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314887168:0@lo:400:kworker.0 00010000:00080000:0.0:1789778197.430422:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f5f80 x1876718314887424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778197.430432:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314887424:0@lo:400:kworker.0 00000100:00100000:2.0:1789778197.430948:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314887552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778197.430985:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778197.431021:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314886912 00000100:00100000:2.0:1789778197.431025:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314886912 00000100:00100000:2.0:1789778197.431050:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887040 00000100:00100000:2.0:1789778197.431053:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887040 00000100:00100000:2.0:1789778197.431090:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887296 00000100:00100000:2.0:1789778197.431094:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887296 00000100:00100000:2.0:1789778197.431108:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789778197.431113:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314886912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778197.431146:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314886912:12345-0@lo:400:kworker.0 Request processed in 33us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778197.431152:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789778197.431165:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789778197.431169:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314887040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778197.431193:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314887040:12345-0@lo:400:kworker.0 Request processed in 24us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778197.431198:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789778197.431209:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789778197.431214:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314887296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778197.431240:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314887296:12345-0@lo:400:kworker.0 Request processed in 26us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778197.431257:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789778197.431332:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887552 00000100:00100000:0.0:1789778197.431336:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887552 00000100:00100000:0.0:1789778197.431370:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789778197.431375:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314887552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778197.431401:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778197.431436:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314887552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778197.431441:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789778197.431455:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778197.431475:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314887296:0@lo:400:kworker.0 00010000:00080000:0.0:1789778197.431500:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98616d80 x1876718314887552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778197.431513:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314887552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778197.431714:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314887040:0@lo:400:kworker.0 00000100:00100000:0.0:1789778197.431725:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314886912:0@lo:400:kworker.0 00000100:00100000:2.0:1789778197.937448:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314887680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778197.937533:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778197.939463:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887680 00000100:00100000:0.0:1789778197.939476:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887680 00000100:00100000:0.0:1789778197.939531:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789778197.939551:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314887680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778197.939586:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778197.939660:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314887680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778197.939677:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789778197.939732:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfb64000 x1876718314887680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778197.939757:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314887680:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789778198.021242:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:1.0:1789778198.021253:0:6716:0:(genops.c:885:class_export_put()) final put ffff9b3d82bc7800/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:0.0:1789778198.021575:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3d82bc7800/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a for lustre-OST0000 00000020:00000080:0.0:1789778198.021628:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3d82bc3800 for lustre-OST0000 00010000:00010000:3.0:1789778198.193204:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778199.217383:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778200.245402:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789778200.897457:0:9242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.110 00010000:00010000:3.0:1789778201.276723:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789778201.583158:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:0.0:1789778201.583168:0:7641:0:(genops.c:885:class_export_put()) final put ffff9b3ebf39a800/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:0.0:1789778201.583197:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf39a800/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a for lustre-OST0001 00000020:00000080:0.0:1789778201.583237:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3eb5811800 for lustre-OST0001 00010000:00010000:1.0:1789778202.293356:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778202.385327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778202.385436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778202.386004:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982080 00000100:00100000:3.0:1789778202.386018:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982080 00000100:00100000:3.0:1789778202.386151:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1789778202.386164:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295982080:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778202.386256:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295982080:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 94us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778202.386264:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00080000:1.0:1789778202.386445:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778202.392562:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295981952 00000100:00100000:0.0:1789778202.392580:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295981952 00000100:00100000:2.0:1789778202.392831:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:2.0:1789778202.392842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295981952:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778202.392929:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295981952:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 89us (7615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778202.392938:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:3.0:1789778202.545519:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314887808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778202.545599:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778202.546502:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887808 00000100:00100000:1.0:1789778202.546515:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887808 00000100:00100000:1.0:1789778202.546596:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778202.546606:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314887808:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778202.546812:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314887936:0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.546865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778202.546895:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314888448:0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.546922:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778202.546943:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778202.546948:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314888064:0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.546993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778202.547025:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314887936 00000100:00100000:0.0:1789778202.547029:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314887936 00000100:00100000:0.0:1789778202.547060:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789778202.547085:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.547140:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314887936:12345-0@lo:400:kworker.0 Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778202.547157:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789778202.547202:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314888192:0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.547230:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778202.547248:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778202.547253:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314888320:0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.547274:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778202.547311:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314887936:0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.547349:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888448 00000100:00100000:0.0:1789778202.547353:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888448 00000100:00100000:0.0:1789778202.547383:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789778202.547390:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314888448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778202.547428:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314888448:12345-0@lo:400:kworker.0 Request processed in 38us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778202.547434:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789778202.547474:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5856a00 x1876718314888448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778202.547487:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314888448:0@lo:400:kworker.0 00000100:00100000:3.0:1789778202.547953:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888064 00000100:00100000:3.0:1789778202.547959:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888064 00000100:00100000:3.0:1789778202.547995:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888192 00000100:00100000:3.0:1789778202.547998:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888192 00000100:00100000:3.0:1789778202.548013:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888320 00000100:00100000:3.0:1789778202.548015:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888320 00000100:00100000:3.0:1789778202.548031:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789778202.548038:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314888064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778202.548117:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314888064:12345-0@lo:400:kworker.0 Request processed in 69us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778202.548123:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789778202.548138:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789778202.548145:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314888192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778202.548189:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314888192:12345-0@lo:400:kworker.0 Request processed in 35us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778202.548206:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789778202.548217:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789778202.548223:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314888320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778202.548252:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314888320:12345-0@lo:400:kworker.0 Request processed in 29us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778202.548258:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789778202.548288:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314888320:0@lo:400:kworker.0 00000100:00100000:3.0:1789778202.548299:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314888192:0@lo:400:kworker.0 00000100:00100000:3.0:1789778202.548326:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314888064:0@lo:400:kworker.0 00000100:00080000:2.0:1789778202.548515:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789778202.548521:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789778202.548523:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789778202.548608:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778202.548676:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314887808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2071us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778202.548682:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789778202.549017:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98617800 x1876718314887808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778202.549035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314887808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778203.057756:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314888576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778203.057834:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778203.057923:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888576 00000100:00100000:2.0:1789778203.057931:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888576 00000100:00100000:2.0:1789778203.057996:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789778203.058008:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314888576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778203.058040:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778203.058312:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314888576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 306us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778203.058320:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789778203.058779:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb90f6a00 x1876718314888576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778203.058801:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314888576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778203.317665:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789778203.567250:0:9340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.110 00010000:00010000:3.0:1789778204.339175:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778205.361219:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789778205.833567:0:9438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.110 00010000:00010000:3.0:1789778206.387854:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778207.410351:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778207.498001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778207.498057:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982336 00000100:00100000:0.0:1789778207.498094:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982336 00000100:00080000:1.0:1789778207.498192:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778207.498241:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:1.0:1789778207.498252:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295982336:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778207.498400:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295982336:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 149us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778207.498409:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1789778207.498466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778207.498563:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982208 00000100:00100000:1.0:1789778207.498570:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982208 00000100:00100000:1.0:1789778207.498629:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:1.0:1789778207.498635:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2372:x1876718295982208:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778207.498689:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2372:x1876718295982208:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 54us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778207.498694:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 200 00000001:02000400:1.0:1789778207.516102:0:9487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 18 20:36:46 EDT 2026 00000100:00100000:2.0:1789778207.675612:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778207.675638:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314888704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778207.675707:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778207.675775:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888704 00000100:00100000:2.0:1789778207.675783:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888704 00000100:00100000:2.0:1789778207.675842:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789778207.675851:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314888704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778207.675891:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778207.675940:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314888704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778207.675949:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789778207.675973:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789778207.676005:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98615180 x1876718314888704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778207.676024:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314888704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778207.683872:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789778207.683964:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778207.683990:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314889216:0@lo:400:kworker.0 00000100:00100000:2.0:1789778207.684124:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778207.684180:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889216 00000100:00100000:2.0:1789778207.684187:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889216 00000100:00100000:2.0:1789778207.684247:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789778207.684256:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314889216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778207.684311:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314889216:12345-0@lo:400:kworker.0 Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778207.684318:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789778207.684350:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778207.684393:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314889216:0@lo:400:kworker.0 00000100:00100000:3.0:1789778207.684469:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314888832:0@lo:400:kworker.0 00000100:00100000:3.0:1789778207.684504:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778207.684545:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314888960:0@lo:400:kworker.0 00000100:00100000:3.0:1789778207.684568:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778207.684586:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778207.684591:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314889088:0@lo:400:kworker.0 00000100:00100000:3.0:1789778207.684612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778207.684635:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888960 00000100:00100000:3.0:1789778207.684644:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888960 00000100:00100000:3.0:1789778207.684665:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889088 00000100:00100000:3.0:1789778207.684668:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889088 00000100:00100000:3.0:1789778207.684685:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789778207.684690:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314888960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778207.684725:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314888960:12345-0@lo:400:kworker.0 Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778207.684731:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789778207.684745:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789778207.684751:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314889088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778207.684777:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314889088:12345-0@lo:400:kworker.0 Request processed in 26us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778207.684783:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789778207.684800:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778207.684817:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314889088:0@lo:400:kworker.0 00000100:00100000:3.0:1789778207.684826:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314888960:0@lo:400:kworker.0 00000100:00100000:2.0:1789778207.684880:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314888832 00000100:00100000:2.0:1789778207.684884:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314888832 00000100:00100000:2.0:1789778207.684916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789778207.684923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314888832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778207.684957:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314888832:12345-0@lo:400:kworker.0 Request processed in 35us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778207.684964:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789778207.685027:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314888832:0@lo:400:kworker.0 00000100:00100000:1.0:1789778207.695643:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314889344:0@lo:400:kworker.0 00000100:00100000:1.0:1789778207.695720:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778207.695773:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889344 00000100:00100000:1.0:1789778207.695780:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889344 00000100:00100000:1.0:1789778207.695841:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789778207.695851:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314889344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778207.695898:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314889344:12345-0@lo:400:kworker.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778207.695905:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789778207.695944:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f6d80 x1876718314889344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778207.695958:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314889344:0@lo:400:kworker.0 00000100:00080000:2.0:1789778207.696094:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778208.179381:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314889472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778208.179474:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778208.179690:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889472 00000100:00100000:3.0:1789778208.179700:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889472 00000100:00100000:3.0:1789778208.179769:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789778208.179781:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314889472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789778208.179819:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778208.179874:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314889472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778208.179882:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789778208.179938:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec1768380 x1876718314889472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778208.179972:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314889472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789778208.433992:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778209.458379:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778210.481866:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778211.505329:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778212.530963:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778212.627663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778212.627711:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778212.627864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982464 00000100:00100000:1.0:1789778212.627876:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982464 00000100:00100000:1.0:1789778212.627943:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:1.0:1789778212.627954:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295982464:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778212.628031:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295982464:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 79us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778212.628051:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:3.0:1789778212.635597:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982592 00000100:00100000:3.0:1789778212.635610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982592 00000100:00100000:3.0:1789778212.635708:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:3.0:1789778212.635719:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295982592:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778212.635810:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295982592:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 93us (8098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778212.635818:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00080000:2.0:1789778212.638585:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778212.785244:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314889728:0@lo:400:kworker.0 00000100:00100000:1.0:1789778212.785331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778212.785385:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314890240:0@lo:400:kworker.0 00000100:00100000:1.0:1789778212.785411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778212.785442:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778212.785449:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314889856:0@lo:400:kworker.0 00000100:00100000:0.0:1789778212.785458:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889728 00000100:00100000:0.0:1789778212.785465:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889728 00000100:00100000:1.0:1789778212.785468:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778212.785492:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314890240 00000100:00100000:1.0:1789778212.785496:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314890240 00000100:00100000:0.0:1789778212.785502:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889856 00000100:00100000:0.0:1789778212.785504:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889856 00000100:00100000:0.0:1789778212.785524:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789778212.785529:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789778212.785533:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314889728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778212.785534:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314890240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778212.785580:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314890240:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778212.785587:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789778212.785590:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314889728:12345-0@lo:400:kworker.0 Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778212.785595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789778212.785606:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789778212.785612:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314889856:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789778212.785616:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789778212.785621:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778212.785638:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314889856:12345-0@lo:400:kworker.0 Request processed in 27us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778212.785643:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789778212.785647:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314889728:0@lo:400:kworker.0 00010000:00080000:1.0:1789778212.785676:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f6680 x1876718314890240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778212.785687:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314890240:0@lo:400:kworker.0 00000100:00100000:0.0:1789778212.785908:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314889856:0@lo:400:kworker.0 00000100:00100000:3.0:1789778212.786314:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314889984:0@lo:400:kworker.0 00000100:00100000:3.0:1789778212.786349:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778212.786379:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789778212.786386:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314889600:0@lo:400:kworker.0 00000100:00100000:3.0:1789778212.786413:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778212.786436:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314890112:0@lo:400:kworker.0 00000100:00100000:3.0:1789778212.786457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778212.786481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314890112 00000100:00100000:3.0:1789778212.786485:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314890112 00000100:00100000:3.0:1789778212.786524:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789778212.786530:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314890112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778212.786567:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314890112:12345-0@lo:400:kworker.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778212.786573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789778212.786616:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889600 00000100:00100000:3.0:1789778212.786619:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889600 00000100:00100000:3.0:1789778212.786639:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789778212.786645:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314889600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778212.786781:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314889984 00000100:00100000:0.0:1789778212.786785:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314889984 00000100:00100000:0.0:1789778212.786811:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789778212.786817:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314889984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778212.786849:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314889984:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778212.786854:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789778212.786916:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314889600:12345-0@lo:400:kworker.0 Request processed in 271us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778212.786922:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789778212.786956:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314889600:0@lo:400:kworker.0 00000100:00100000:3.0:1789778212.786967:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314890112:0@lo:400:kworker.0 00010000:00080000:3.0:1789778212.786977:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f5180 x1876718314889984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778212.786986:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314889984:0@lo:400:kworker.0 00000100:00080000:1.0:1789778212.787107:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789778212.787112:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778212.791464:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314890368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778212.791553:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778212.791610:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314890368 00000100:00100000:1.0:1789778212.791617:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314890368 00000100:00100000:1.0:1789778212.791667:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789778212.791688:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314890368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789778212.791726:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778212.791773:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314890368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778212.791779:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789778212.791820:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f6680 x1876718314890368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778212.791842:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314890368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778213.297289:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778213.297322:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314890496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778213.297399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778213.297495:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314890496 00000100:00100000:3.0:1789778213.297504:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314890496 00000100:00100000:3.0:1789778213.297551:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789778213.297560:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314890496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789778213.297599:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778213.297639:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314890496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778213.297646:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789778213.297720:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec176ad80 x1876718314890496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778213.297739:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314890496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778213.555274:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778214.583624:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778215.601548:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778216.625509:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778217.650011:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778217.738589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778217.738638:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778217.738756:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982848 00000100:00100000:3.0:1789778217.738768:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982848 00000100:00100000:3.0:1789778217.738859:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:3.0:1789778217.738870:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295982848:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778217.738965:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295982848:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 97us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778217.738973:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:0.0:1789778217.739865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982720 00000100:00100000:0.0:1789778217.739872:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982720 00000100:00100000:0.0:1789778217.739913:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:0.0:1789778217.739920:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2372:x1876718295982720:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778217.739959:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2372:x1876718295982720:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 39us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778217.739966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00080000:2.0:1789778217.741086:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778217.905807:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314890624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778217.905882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778217.905962:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314890624 00000100:00100000:0.0:1789778217.905970:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314890624 00000100:00100000:0.0:1789778217.906028:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789778217.906037:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314890624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778217.906087:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778217.906145:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314890624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778217.906163:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789778217.906191:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789778217.906220:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb90f4e00 x1876718314890624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778217.906239:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314890624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778217.909773:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314891008:0@lo:400:kworker.0 00000100:00100000:0.0:1789778217.909851:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778217.909904:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778217.909919:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314891136:0@lo:400:kworker.0 00000100:00100000:0.0:1789778217.909943:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778217.909977:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891008 00000100:00100000:0.0:1789778217.909985:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891008 00000100:00100000:0.0:1789778217.910037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891136 00000100:00100000:0.0:1789778217.910040:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891136 00000100:00100000:0.0:1789778217.910086:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789778217.910095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314891008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778217.910144:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314891008:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778217.910163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789778217.910188:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789778217.910195:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314891136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778217.910221:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314891136:12345-0@lo:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778217.910228:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789778217.910250:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778217.910280:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314891136:0@lo:400:kworker.0 00000100:00100000:0.0:1789778217.910291:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314891008:0@lo:400:kworker.0 00000100:00100000:1.0:1789778217.910672:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314890752:0@lo:400:kworker.0 00000100:00100000:1.0:1789778217.910706:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778217.910737:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314891264:0@lo:400:kworker.0 00000100:00100000:1.0:1789778217.910760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778217.910785:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778217.910790:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314890880:0@lo:400:kworker.0 00000100:00100000:1.0:1789778217.910812:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778217.911285:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891264 00000100:00100000:2.0:1789778217.911292:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891264 00000100:00100000:2.0:1789778217.911334:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789778217.911342:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314891264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778217.911393:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314891264:12345-0@lo:400:kworker.0 Request processed in 51us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778217.911400:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789778217.911434:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec700 x1876718314891264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778217.911446:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314891264:0@lo:400:kworker.0 00000100:00080000:2.0:1789778217.911464:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778217.912931:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314890752 00000100:00100000:0.0:1789778217.912943:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314890752 00000100:00100000:0.0:1789778217.912996:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789778217.913006:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314890752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778217.913089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314890752:12345-0@lo:400:kworker.0 Request processed in 85us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778217.913097:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789778217.913138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314890880 00000100:00100000:0.0:1789778217.913142:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314890880 00000100:00100000:0.0:1789778217.913178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789778217.913195:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314890880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778217.913227:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314890880:12345-0@lo:400:kworker.0 Request processed in 33us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778217.913233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789778217.913397:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314890880:0@lo:400:kworker.0 00000100:00100000:2.0:1789778217.913408:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314890752:0@lo:400:kworker.0 00000100:00100000:3.0:1789778218.417698:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789778218.417718:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314891392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778218.417807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778218.418023:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891392 00000100:00100000:0.0:1789778218.418031:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891392 00000100:00100000:0.0:1789778218.418108:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789778218.418118:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314891392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778218.418398:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778218.418455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314891392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 338us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778218.418462:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789778218.418802:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec176ad80 x1876718314891392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778218.418832:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314891392:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789778218.674617:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778219.697609:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778220.732914:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778221.745529:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778222.769452:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778222.864504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778222.864554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778222.864570:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295982976 00000100:00100000:0.0:1789778222.864580:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295982976 00000100:00100000:0.0:1789778222.864639:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:0.0:1789778222.864650:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295982976:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778222.864723:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2373:x1876718295982976:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778222.864731:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:0.0:1789778222.864773:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295983104 00000100:00100000:0.0:1789778222.864777:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295983104 00000100:00100000:0.0:1789778222.864826:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00080000:3.0:1789778222.864834:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778222.864834:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295983104:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778222.864868:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295983104:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778222.864885:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1789778223.037634:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314891648:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.037712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778223.037762:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314892160:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.037789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778223.037831:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789778223.037837:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314891520:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.037864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778223.037883:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314892032:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.037901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778223.037923:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314891904:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.037945:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778223.037962:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778223.037967:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb90f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314891776:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.037986:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778223.038012:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891648 00000100:00100000:0.0:1789778223.038019:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891648 00000100:00100000:0.0:1789778223.038060:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892032 00000100:00100000:0.0:1789778223.038081:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892032 00000100:00100000:0.0:1789778223.038118:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891776 00000100:00100000:0.0:1789778223.038121:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891776 00000100:00100000:0.0:1789778223.038137:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789778223.038146:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314891648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.038200:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314891648:12345-0@lo:400:kworker.0 Request processed in 54us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.038208:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789778223.038232:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789778223.038238:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314892032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.038267:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314892032:12345-0@lo:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.039374:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789778223.039397:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789778223.039406:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314891776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.039458:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314891776:12345-0@lo:400:kworker.0 Request processed in 54us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.039464:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789778223.039486:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892160 00000100:00100000:0.0:1789778223.039491:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892160 00000100:00100000:0.0:1789778223.039605:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891904 00000100:00100000:0.0:1789778223.039610:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891904 00000100:00100000:0.0:1789778223.039639:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789778223.039646:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314892160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.039680:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314892160:12345-0@lo:400:kworker.0 Request processed in 35us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.039687:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789778223.039698:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789778223.039705:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314891904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.039730:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314891904:12345-0@lo:400:kworker.0 Request processed in 26us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.039736:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789778223.039754:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314891520 00000100:00100000:0.0:1789778223.039758:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314891520 00000100:00100000:0.0:1789778223.039782:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789778223.039796:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314891520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.039895:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314891520:12345-0@lo:400:kworker.0 Request processed in 99us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.039901:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1789778223.039941:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789778223.039945:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789778223.039948:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778223.039987:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314891776:0@lo:400:kworker.0 00010000:00080000:0.0:1789778223.040001:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb90f5f80 x1876718314891904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778223.040011:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314891904:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.040045:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314891520:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.040056:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314892032:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.040085:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314891648:0@lo:400:kworker.0 00010000:00080000:0.0:1789778223.040108:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb90f4000 x1876718314892160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778223.040117:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb90f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314892160:0@lo:400:kworker.0 00000100:00100000:0.0:1789778223.041461:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314892288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778223.041511:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778223.041652:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892288 00000100:00100000:2.0:1789778223.041658:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892288 00000100:00100000:2.0:1789778223.041702:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789778223.041710:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314892288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778223.041743:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778223.041784:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314892288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.041791:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789778223.043155:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec700 x1876718314892288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778223.043192:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314892288:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789778223.189924:0:10117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:37:01 (1789778221) === 00000100:00100000:1.0:1789778223.540601:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778223.540682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778223.540875:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892416 00000100:00100000:2.0:1789778223.540884:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892416 00000100:00100000:2.0:1789778223.540937:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789778223.540947:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314892416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778223.540981:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778223.541048:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314892416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.541056:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789778223.541170:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec0ead500 x1876718314892416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778223.541189:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778223.692981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.693290:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295983232 00000100:00100000:0.0:1789778223.693302:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295983232 00000100:00100000:0.0:1789778223.693361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:0.0:1789778223.693372:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:8159:x1876718295983232:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789778223.693511:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778223.693538:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757600/0x5a1e1c1157440ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7a9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778223.693571:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757600/0x5a1e1c1157440ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a9c expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778223.693583:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757600/0x5a1e1c1157440ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a9c expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778223.693593:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757600, rc 0) 00000100:00100000:0.0:1789778223.693658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8159:x1876718295983232:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 287us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.693666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:0.0:1789778223.729950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.730054:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295983360 00000100:00100000:2.0:1789778223.730101:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295983360 00000100:00100000:2.0:1789778223.730171:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:2.0:1789778223.730182:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8159:x1876718295983360:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789778223.730637:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8159:x1876718295983360:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 456us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.730646:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:3.0:1789778223.735618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.739712:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295983488 00000100:00100000:2.0:1789778223.739760:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295983488 00000100:00100000:2.0:1789778223.739877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:2.0:1789778223.739892:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8159:x1876718295983488:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789778223.740284:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8159:x1876718295983488:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 393us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.740292:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:3.0:1789778223.752270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.752521:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295983616 00000100:00100000:0.0:1789778223.752532:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295983616 00000100:00100000:0.0:1789778223.752589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:0.0:1789778223.752600:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8163:x1876718295983616:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789778223.752882:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8163:x1876718295983616:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 283us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.752890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 211 00010000:00010000:3.0:1789778223.794347:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778223.804671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.805275:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295983744 00000100:00100000:0.0:1789778223.805288:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295983744 00000100:00100000:0.0:1789778223.805364:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:0.0:1789778223.805384:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8163:x1876718295983744:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789778223.806164:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8163:x1876718295983744:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 787us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.806174:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:3.0:1789778223.823942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.824124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295983872 00000100:00100000:2.0:1789778223.824146:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295983872 00000100:00100000:2.0:1789778223.824204:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:2.0:1789778223.824215:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+11:8159:x1876718295983872:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789778223.824231:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778223.824250:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657200/0x5a1e1c1157440de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ac6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778223.824287:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657200/0x5a1e1c1157440de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ac6 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778223.824316:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657200/0x5a1e1c1157440de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ac6 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778223.824327:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657200, rc 0) 00000100:00100000:2.0:1789778223.824393:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:8159:x1876718295983872:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 179us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.824399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:1.0:1789778223.840629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778223.842798:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984000 00000100:00100000:3.0:1789778223.842825:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984000 00000100:00100000:3.0:1789778223.842900:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:3.0:1789778223.842910:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:8159:x1876718295984000:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789778223.842936:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789778223.842962:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789778223.842966:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789778223.842970:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789778223.842972:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789778223.855786:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:8159:x1876718295984000:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 12866us (15156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.855811:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:0.0:1789778223.861725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.861925:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984128 00000100:00100000:2.0:1789778223.861938:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984128 00000100:00100000:2.0:1789778223.862009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:2.0:1789778223.862021:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+12:8159:x1876718295984128:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789778223.862045:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778223.862144:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7acd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778223.862177:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778223.862187:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778223.862196:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657000, rc 0) 00000100:00100000:2.0:1789778223.862267:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8159:x1876718295984128:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 248us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.862275:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:1.0:1789778223.866681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.866944:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984256 00000100:00100000:0.0:1789778223.866953:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984256 00000100:00100000:0.0:1789778223.867015:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:0.0:1789778223.867027:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8159:x1876718295984256:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789778223.867500:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8159:x1876718295984256:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 474us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.867509:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:3.0:1789778223.872730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.872849:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984384 00000100:00100000:0.0:1789778223.872861:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984384 00000100:00100000:0.0:1789778223.872921:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:0.0:1789778223.872932:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8159:x1876718295984384:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789778223.873301:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8159:x1876718295984384:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 368us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.873310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:0.0:1789778223.878653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.879060:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984512 00000100:00100000:2.0:1789778223.879113:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984512 00000100:00100000:2.0:1789778223.879516:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:2.0:1789778223.879529:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8168:x1876718295984512:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789778223.879997:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8168:x1876718295984512:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 469us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.880006:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:1.0:1789778223.888676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.890052:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984640 00000100:00100000:0.0:1789778223.890086:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984640 00000100:00100000:0.0:1789778223.890457:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:0.0:1789778223.890484:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8168:x1876718295984640:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789778223.890970:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:8168:x1876718295984640:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 487us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.890980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:0.0:1789778223.895952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.896037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.896641:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984896 00000100:00100000:2.0:1789778223.896651:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984896 00000100:00100000:1.0:1789778223.896798:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295984768 00000100:00100000:1.0:1789778223.896871:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295984768 00000100:00100000:1.0:1789778223.896948:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:1.0:1789778223.896960:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295984896:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778223.897043:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295984896:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 86us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778223.897051:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:1.0:1789778223.897101:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1789778223.897106:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2371:x1876718295984768:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789778223.897126:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 14c48d7e-8983-41f6-9a41-ddf92e2ec256@192.168.201.45@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:1.0:1789778223.901968:0:5845:0:(genops.c:1385:class_connect()) connect: client 14c48d7e-8983-41f6-9a41-ddf92e2ec256, cookie 0x5a1e1c1157440df1 00000004:00100000:1.0:1789778223.902010:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789778223.902334:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9b3ea019c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789778223.902439:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2371:x1876718295984768:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 5328us (6398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778223.902464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1789778223.907406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778223.907550:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985024 00000100:00100000:1.0:1789778223.907570:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985024 00000100:00100000:1.0:1789778223.907652:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1789778223.907663:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:0:x1876718295985024:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789778223.907710:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789778223.907820:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:0:x1876718295985024:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 158us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778223.907829:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00080000:3.0:1789778223.908895:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778223.912280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778223.912414:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985152 00000100:00100000:1.0:1789778223.912429:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985152 00000100:00100000:1.0:1789778223.912519:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778223.912533:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:8159:x1876718295985152:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789778223.912588:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789778223.912686:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:8159:x1876718295985152:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 156us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778223.912693:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778223.930204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778223.930421:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985280 00000100:00100000:0.0:1789778223.930432:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985280 00000100:00100000:0.0:1789778223.930497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1789778223.930507:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:8159:x1876718295985280:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789778223.930599:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:8159:x1876718295985280:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 93us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778223.930607:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1789778223.933279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.933537:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985664 00000100:00100000:2.0:1789778223.933547:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985664 00000100:00100000:2.0:1789778223.933602:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1789778223.933612:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:8159:x1876718295985664:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789778223.933685:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789778223.933769:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:8159:x1876718295985664:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 158us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.933776:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1789778223.933958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778223.934232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778223.934522:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985408 00000100:00100000:2.0:1789778223.934528:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985408 00000100:00100000:2.0:1789778223.934555:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985536 00000100:00100000:2.0:1789778223.934558:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985536 00000100:00100000:2.0:1789778223.934580:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:2.0:1789778223.934585:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2371:x1876718295985408:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789778223.934611:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 14c48d7e-8983-41f6-9a41-ddf92e2ec256@192.168.201.45@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1789778223.934638:0:6693:0:(genops.c:1385:class_connect()) connect: client 14c48d7e-8983-41f6-9a41-ddf92e2ec256, cookie 0x5a1e1c1157440df8 00002000:00100000:2.0:1789778223.934651:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14c48d7e-8983-41f6-9a41-ddf92e2ec256/ffff9b3ec1642000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789778223.934662:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789778223.934899:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1789778223.934905:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2371:x1876718295985536:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789778223.934922:0:8205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 14c48d7e-8983-41f6-9a41-ddf92e2ec256@192.168.201.45@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:3.0:1789778223.934940:0:8205:0:(genops.c:1385:class_connect()) connect: client 14c48d7e-8983-41f6-9a41-ddf92e2ec256, cookie 0x5a1e1c1157440dff 00002000:00100000:3.0:1789778223.934947:0:8205:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14c48d7e-8983-41f6-9a41-ddf92e2ec256/ffff9b3ec13f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789778223.934953:0:8205:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789778223.935163:0:8205:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789778223.935190:0:8205:0:(import.c:65:import_set_state_nolock()) ffff9b3ec13f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789778223.935237:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2371:x1876718295985536:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 331us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778223.935245:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00002000:00080000:2.0:1789778223.935488:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789778223.935505:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1645000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778223.935532:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2371:x1876718295985408:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 944us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778223.935539:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00010000:00010000:3.0:1789778224.817553:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778225.847179:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778226.865746:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789778227.187628:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14c48d7e-8983-41f6-9a41-ddf92e2ec256 00000001:00100000:0.0:1789778227.189540:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14c48d7e-8983-41f6-9a41-ddf92e2ec256 00010000:00010000:0.0:1789778227.889278:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778228.145337:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789778228.150024:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314892672:0@lo:400:kworker.0 00000100:00100000:1.0:1789778228.150134:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778228.150204:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314892544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778228.150232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778228.150411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892672 00000100:00100000:0.0:1789778228.150422:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892672 00000100:00100000:0.0:1789778228.150480:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789778228.150489:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314892672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778228.150557:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314892672:12345-0@lo:400:kworker.0 Request processed in 68us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778228.150565:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789778228.150613:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314892672:0@lo:400:kworker.0 00000100:00100000:3.0:1789778228.150985:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892544 00000100:00100000:3.0:1789778228.150990:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892544 00000100:00100000:3.0:1789778228.151045:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789778228.151053:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314892544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778228.151107:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778228.151151:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314892544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778228.151158:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789778228.151481:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789778228.151575:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec380 x1876718314892544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778228.151595:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314892544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778228.152750:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314892928:0@lo:400:kworker.0 00000100:00100000:3.0:1789778228.152803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778228.152840:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778228.152847:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314892800:0@lo:400:kworker.0 00000100:00100000:3.0:1789778228.152946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778228.153098:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892928 00000100:00100000:2.0:1789778228.153106:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892928 00000100:00100000:2.0:1789778228.153152:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314892800 00000100:00100000:2.0:1789778228.153155:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314892800 00000100:00100000:2.0:1789778228.153178:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789778228.153186:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314892928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778228.153237:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314892928:12345-0@lo:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778228.153245:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789778228.153261:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789778228.153267:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314892800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778228.153460:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314893056:0@lo:400:kworker.0 00000100:00100000:0.0:1789778228.153490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778228.153571:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778228.153578:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314893184:0@lo:400:kworker.0 00000100:00100000:0.0:1789778228.153605:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778228.153632:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893184 00000100:00100000:0.0:1789778228.153635:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893184 00000100:00080000:3.0:1789778228.153771:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778228.154457:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314892800:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778228.154469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789778228.154488:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893056 00000100:00100000:2.0:1789778228.154492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893056 00000100:00100000:0.0:1789778228.154630:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789778228.154638:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314893184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778228.154805:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314893184:12345-0@lo:400:kworker.0 Request processed in 167us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778228.154813:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789778228.154855:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbef800 x1876718314893184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778228.155011:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789778228.155019:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314893056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778228.155055:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314893056:12345-0@lo:400:kworker.0 Request processed in 38us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778228.155061:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789778228.155313:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778228.155319:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778228.155466:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314893184:0@lo:400:kworker.0 00000100:00100000:0.0:1789778228.155481:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314893056:0@lo:400:kworker.0 00000100:00100000:2.0:1789778228.155629:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314892800:0@lo:400:kworker.0 00000100:00100000:2.0:1789778228.155978:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314892928:0@lo:400:kworker.0 00000100:00100000:3.0:1789778228.665459:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778228.665490:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314893312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778228.665581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778228.666463:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893312 00000100:00100000:1.0:1789778228.666473:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893312 00000100:00100000:1.0:1789778228.666560:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789778228.666570:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314893312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789778228.666605:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778228.666662:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314893312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778228.666669:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789778228.666961:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec0eace00 x1876718314893312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778228.666982:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314893312:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789778228.749385:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14c48d7e-8983-41f6-9a41-ddf92e2ec256 00010000:00010000:0.0:1789778228.913310:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778229.009090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778229.009131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778229.009166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778229.009193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778229.009214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778229.009240:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986048 00000100:00100000:2.0:1789778229.009249:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986048 00000100:00100000:2.0:1789778229.009308:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985920 00000100:00100000:2.0:1789778229.009311:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985920 00000100:00100000:2.0:1789778229.009329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:2.0:1789778229.009338:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295986048:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778229.009418:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295986048:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778229.009426:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:0.0:1789778229.009433:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295985792 00000100:00100000:0.0:1789778229.009438:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295985792 00000100:00100000:2.0:1789778229.009443:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1789778229.009448:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295985920:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778229.009465:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:0.0:1789778229.009471:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295985792:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778229.009472:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295985920:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778229.009478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1789778229.009493:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986304 00000100:00100000:2.0:1789778229.009496:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986304 00000100:00100000:2.0:1789778229.009521:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986176 00000100:00100000:2.0:1789778229.009524:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986176 00000100:00100000:0.0:1789778229.009525:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295985792:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778229.009531:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:2.0:1789778229.009540:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:2.0:1789778229.009553:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295986304:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778229.009558:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1789778229.009563:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295986176:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778229.009578:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295986304:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778229.009582:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295986176:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 18us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778229.009584:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1789778229.009587:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00080000:3.0:1789778229.010455:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789778229.010461:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778229.010464:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789778229.937434:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778230.961507:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789778231.244593:0:10314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789778231.987599:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778233.016576:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778233.270060:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314893440:0@lo:400:kworker.0 00000100:00100000:2.0:1789778233.270149:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778233.270194:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314893952:0@lo:400:kworker.0 00000100:00100000:2.0:1789778233.270219:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778233.270243:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778233.270249:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314893824:0@lo:400:kworker.0 00000100:00100000:2.0:1789778233.270274:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778233.270302:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893952 00000100:00100000:2.0:1789778233.270309:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893952 00000100:00100000:2.0:1789778233.270361:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789778233.270370:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314893952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778233.270419:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314893952:12345-0@lo:400:kworker.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778233.270427:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789778233.270450:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893824 00000100:00100000:2.0:1789778233.270454:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893824 00000100:00100000:2.0:1789778233.270479:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789778233.270486:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314893824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778233.270515:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314893824:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778233.270521:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789778233.270567:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec000 x1876718314893824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778233.270581:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314893824:0@lo:400:kworker.0 00000100:00100000:2.0:1789778233.270591:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314893952:0@lo:400:kworker.0 00000100:00080000:2.0:1789778233.270624:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789778233.270629:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778233.273688:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314893568:0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.273750:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778233.273786:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314894080:0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.273808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778233.273828:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778233.273833:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314893696:0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.273850:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778233.273884:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894080 00000100:00100000:0.0:1789778233.273891:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894080 00000100:00100000:0.0:1789778233.273948:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789778233.273956:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314894080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.274007:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314894080:12345-0@lo:400:kworker.0 Request processed in 52us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778233.274025:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789778233.274058:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbed500 x1876718314894080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778233.274092:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314894080:0@lo:400:kworker.0 00000100:00080000:0.0:1789778233.274113:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778233.274163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893568 00000100:00100000:0.0:1789778233.274168:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893568 00000100:00100000:0.0:1789778233.274193:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893696 00000100:00100000:0.0:1789778233.274196:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893696 00000100:00100000:0.0:1789778233.274221:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789778233.274227:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314893568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.274263:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314893568:12345-0@lo:400:kworker.0 Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778233.274269:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789778233.274281:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789778233.274287:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314893696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.274314:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314893696:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778233.274320:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789778233.274337:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314893440 00000100:00100000:0.0:1789778233.274340:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314893440 00000100:00100000:0.0:1789778233.274362:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789778233.274369:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314893440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.274404:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314893440:12345-0@lo:400:kworker.0 Request processed in 36us (4255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778233.274410:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1789778233.274439:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778233.274456:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314893696:0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.274465:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314893568:0@lo:400:kworker.0 00000100:00100000:0.0:1789778233.274499:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314893440:0@lo:400:kworker.0 00000100:00100000:3.0:1789778233.285446:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778233.285472:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314894208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778233.285548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778233.285726:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894208 00000100:00100000:3.0:1789778233.285735:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894208 00000100:00100000:3.0:1789778233.285783:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789778233.285791:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314894208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778233.285826:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778233.285871:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314894208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778233.285892:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789778233.291212:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec0eace00 x1876718314894208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778233.291244:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314894208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778233.778311:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778233.778333:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314894336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778233.781690:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778233.785098:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894336 00000100:00100000:1.0:1789778233.785113:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894336 00000100:00100000:1.0:1789778233.785188:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789778233.785200:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314894336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789778233.785245:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778233.785327:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314894336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778233.785333:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789778233.785385:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfb67480 x1876718314894336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778233.785416:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314894336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778234.038439:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778234.128051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778234.128155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778234.128158:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986560 00000100:00100000:1.0:1789778234.128169:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986560 00000100:00100000:3.0:1789778234.128206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778234.128231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778234.128288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778234.128308:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986432 00000100:00100000:3.0:1789778234.128312:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986432 00000100:00100000:3.0:1789778234.128367:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:3.0:1789778234.128377:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295986432:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778234.128453:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295986432:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778234.128461:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:3.0:1789778234.128495:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986688 00000100:00100000:3.0:1789778234.128498:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986688 00000100:00100000:3.0:1789778234.128522:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:3.0:1789778234.128529:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718295986560:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778234.128609:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986816 00000100:00100000:2.0:1789778234.128614:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986816 00000100:00100000:2.0:1789778234.128645:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295986944 00000100:00100000:2.0:1789778234.128647:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295986944 00000100:00100000:2.0:1789778234.128668:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1789778234.128675:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295986816:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778234.128702:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:2.0:1789778234.128709:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295986816:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 34us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778234.128715:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295986688:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778234.128722:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1789778234.128740:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1789778234.128747:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295986944:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778234.128786:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295986944:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 40us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778234.128793:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:1.0:1789778234.128854:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295986688:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 143us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778234.128862:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00080000:1.0:1789778234.128884:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789778234.128889:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789778234.128910:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778234.129160:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718295986560:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 630us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778234.129168:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00010000:00010000:0.0:1789778235.063865:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778236.081363:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778237.105428:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778238.131025:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778238.385213:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314894720:0@lo:400:kworker.0 00000100:00100000:2.0:1789778238.385228:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314894848:0@lo:400:kworker.0 00000100:00100000:2.0:1789778238.385292:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778238.385344:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778238.385346:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789778238.385352:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314894464:0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.385368:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314895232:0@lo:400:kworker.0 00000100:00100000:2.0:1789778238.385380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778238.385391:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778238.385401:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314894976:0@lo:400:kworker.0 00000100:00100000:2.0:1789778238.385422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778238.385445:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314894592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778238.385467:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778238.385477:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894848 00000100:00100000:2.0:1789778238.385482:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314895104:0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.385486:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894848 00000100:00100000:2.0:1789778238.385502:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778238.385529:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894464 00000100:00100000:2.0:1789778238.385533:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894464 00000100:00100000:2.0:1789778238.385573:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789778238.385582:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314894464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778238.385630:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314894464:12345-0@lo:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778238.385637:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789778238.385681:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314894464:0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386108:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894720 00000100:00100000:3.0:1789778238.386113:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894720 00000100:00100000:3.0:1789778238.386124:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314895104 00000100:00100000:3.0:1789778238.386126:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314895104 00000100:00100000:3.0:1789778238.386139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789778238.386144:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314894848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386182:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314894848:12345-0@lo:400:kworker.0 Request processed in 38us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778238.386189:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789778238.386199:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789778238.386204:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314894720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386227:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314894720:12345-0@lo:400:kworker.0 Request processed in 23us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778238.386232:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789778238.386241:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789778238.386245:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314895104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386377:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314895104:12345-0@lo:400:kworker.0 Request processed in 131us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778238.386384:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789778238.386402:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314895232 00000100:00100000:3.0:1789778238.386405:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314895232 00000100:00100000:3.0:1789778238.386428:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894976 00000100:00100000:3.0:1789778238.386430:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894976 00000100:00100000:3.0:1789778238.386444:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778238.386449:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314895232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386475:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314895232:12345-0@lo:400:kworker.0 Request processed in 26us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778238.386488:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778238.386498:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789778238.386514:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314894976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386538:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314894976:12345-0@lo:400:kworker.0 Request processed in 25us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778238.386543:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789778238.386585:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314895104:0@lo:400:kworker.0 00010000:00080000:3.0:1789778238.386608:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec700 x1876718314895232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778238.386619:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314895232:0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386627:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314894720:0@lo:400:kworker.0 00010000:00080000:3.0:1789778238.386644:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec380 x1876718314894976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778238.386653:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314894976:0@lo:400:kworker.0 00000100:00100000:3.0:1789778238.386660:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314894848:0@lo:400:kworker.0 00000100:00080000:2.0:1789778238.388101:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789778238.388109:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789778238.388114:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778238.391149:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314894592 00000100:00100000:0.0:1789778238.391166:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314894592 00000100:00100000:0.0:1789778238.391222:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789778238.391246:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314894592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778238.391286:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778238.391376:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314894592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (5907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778238.391385:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789778238.391556:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec0eaca80 x1876718314894592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778238.391578:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314894592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778238.899281:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789778238.899312:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314895360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778238.899390:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778238.899599:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314895360 00000100:00100000:0.0:1789778238.899608:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314895360 00000100:00100000:0.0:1789778238.899666:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789778238.899678:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314895360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778238.899720:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778238.899777:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314895360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778238.899802:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789778238.900919:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f5180 x1876718314895360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778238.900957:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314895360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778239.158474:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778239.244277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778239.244334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778239.244481:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987200 00000100:00100000:2.0:1789778239.244492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987200 00000100:00100000:2.0:1789778239.244572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:2.0:1789778239.244583:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295987200:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778239.244661:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295987200:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778239.244681:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:0.0:1789778239.245302:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987072 00000100:00100000:0.0:1789778239.245318:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987072 00000100:00100000:0.0:1789778239.245356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 225 00000100:00100000:0.0:1789778239.245363:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718295987072:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778239.245401:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718295987072:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 38us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778239.245407:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 225 00000100:00080000:3.0:1789778239.245570:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778239.250440:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778239.250503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778239.250558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778239.250589:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987328 00000100:00100000:3.0:1789778239.250598:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987328 00000100:00100000:3.0:1789778239.250654:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:3.0:1789778239.250665:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295987328:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778239.250996:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295987328:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 332us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778239.251005:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:3.0:1789778239.251229:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987456 00000100:00100000:3.0:1789778239.251234:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987456 00000100:00100000:3.0:1789778239.251263:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987584 00000100:00100000:3.0:1789778239.251266:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987584 00000100:00100000:3.0:1789778239.251286:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1789778239.251293:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295987456:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778239.251384:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295987456:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 90us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778239.251392:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1789778239.251405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1789778239.251412:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295987584:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778239.251436:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295987584:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778239.251442:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00080000:3.0:1789778239.252205:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778239.252210:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789778239.252213:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789778240.177510:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778241.202256:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778242.225330:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778243.252371:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778243.505266:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789778243.505292:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314895488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778243.505376:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778243.505491:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314895488 00000100:00100000:3.0:1789778243.505499:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314895488 00000100:00100000:3.0:1789778243.505568:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778243.505578:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314895488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778243.505614:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778243.505661:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314895488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778243.505667:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789778243.505688:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789778243.505716:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e909c7b80 x1876718314895488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778243.505743:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314895488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778243.517913:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314895616:0@lo:400:kworker.0 00000100:00100000:0.0:1789778243.517988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778243.518593:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314895744:0@lo:400:kworker.0 00000100:00100000:1.0:1789778243.518673:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778243.518713:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314895744 00000100:00100000:1.0:1789778243.518720:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314895744 00000100:00100000:1.0:1789778243.518779:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789778243.518788:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314895744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778243.518832:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314895744:12345-0@lo:400:kworker.0 Request processed in 45us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778243.518838:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789778243.518877:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314895744:0@lo:400:kworker.0 00000100:00100000:0.0:1789778243.525532:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314895616 00000100:00100000:0.0:1789778243.525549:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314895616 00000100:00100000:0.0:1789778243.525624:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789778243.525634:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314895616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778243.525744:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314895616:12345-0@lo:400:kworker.0 Request processed in 111us (7755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778243.525751:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789778243.525806:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314895616:0@lo:400:kworker.0 00000100:00100000:3.0:1789778243.525948:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314895872:0@lo:400:kworker.0 00000100:00100000:3.0:1789778243.525989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778243.526036:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314895872 00000100:00100000:3.0:1789778243.526040:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314895872 00000100:00100000:3.0:1789778243.526096:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789778243.526104:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314895872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778243.526152:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314895872:12345-0@lo:400:kworker.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778243.526158:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789778243.526174:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778243.526194:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314895872:0@lo:400:kworker.0 00000100:00100000:3.0:1789778243.526238:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789778243.526245:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314896000:0@lo:400:kworker.0 00000100:00100000:3.0:1789778243.526268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778243.526513:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896000 00000100:00100000:1.0:1789778243.526517:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896000 00000100:00100000:1.0:1789778243.526552:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789778243.526558:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314896000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778243.526595:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314896000:12345-0@lo:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778243.526609:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789778243.526634:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789778243.526642:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314896128:0@lo:400:kworker.0 00000100:00100000:1.0:1789778243.526692:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778243.526718:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896128 00000100:00100000:1.0:1789778243.526721:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896128 00000100:00100000:1.0:1789778243.526763:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789778243.526770:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314896128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778243.526805:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314896128:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778243.526811:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789778243.526838:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e909c7100 x1876718314896128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778243.526849:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314896128:0@lo:400:kworker.0 00000100:00100000:1.0:1789778243.526871:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314896000:0@lo:400:kworker.0 00000100:00080000:3.0:1789778243.527758:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778243.527765:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778244.022033:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778244.022056:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314896256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778244.022136:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778244.022193:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896256 00000100:00100000:3.0:1789778244.022200:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896256 00000100:00100000:3.0:1789778244.022252:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789778244.022261:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314896256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789778244.022293:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778244.022345:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314896256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778244.022353:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789778244.022395:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e909c6d80 x1876718314896256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778244.022413:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314896256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778244.273454:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778244.363645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778244.363690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778244.363752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778244.363761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987712 00000100:00100000:0.0:1789778244.363772:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987712 00000100:00100000:2.0:1789778244.363784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778244.363806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778244.363821:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:0.0:1789778244.363831:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718295987712:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778244.363899:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987840 00000100:00100000:3.0:1789778244.363903:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987840 00000100:00100000:3.0:1789778244.363949:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295987968 00000100:00100000:3.0:1789778244.363952:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295987968 00000100:00100000:3.0:1789778244.363975:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1789778244.363982:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295987840:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778244.364034:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295987840:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 52us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778244.364055:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1789778244.364098:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:3.0:1789778244.364105:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718295987968:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778244.364130:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718295987968:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778244.364137:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00080000:0.0:1789778244.364144:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778244.364584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718295987712:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 565us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778244.364592:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:3.0:1789778244.364684:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988096 00000100:00100000:3.0:1789778244.364689:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988096 00000100:00080000:0.0:1789778244.364741:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789778244.364776:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988224 00000100:00100000:3.0:1789778244.364780:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988224 00000100:00080000:0.0:1789778244.364859:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778244.367679:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1789778244.367701:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2371:x1876718295988096:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:1.0:1789778244.367743:0:8205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440df8 00000100:00080000:1.0:1789778244.367753:0:8205:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1645000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789778244.367794:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789778244.367799:0:8205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789778244.368208:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+2:2371:x1876718295988096:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 516us (4422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778244.368217:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1789778244.368250:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1789778244.368257:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2371:x1876718295988224:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:1.0:1789778244.368272:0:8205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440dff 00000100:00080000:1.0:1789778244.368278:0:8205:0:(import.c:65:import_set_state_nolock()) ffff9b3ec13f7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789778244.368310:0:8205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789778244.368500:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+2:2371:x1876718295988224:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 242us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778244.368507:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:0.0:1789778244.368812:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778245.297261:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778246.321452:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778247.345404:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789778247.738534:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14c48d7e-8983-41f6-9a41-ddf92e2ec256 00000020:00000080:2.0:1789778247.738544:0:7641:0:(genops.c:885:class_export_put()) final put ffff9b3ec13f1800/14c48d7e-8983-41f6-9a41-ddf92e2ec256 00000020:00000080:0.0:1789778247.738704:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec13f1800/14c48d7e-8983-41f6-9a41-ddf92e2ec256 for lustre-OST0001 00000020:00000080:0.0:1789778247.764477:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ec13f7800 for lustre-OST0001 00010000:00010000:0.0:1789778248.370181:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789778248.388269:0:11018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789778248.631243:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314896384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778248.631317:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778248.631391:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896384 00000100:00100000:2.0:1789778248.631399:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896384 00000100:00100000:2.0:1789778248.631466:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789778248.631476:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314896384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778248.631510:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778248.631552:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314896384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778248.631559:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789778248.631579:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789778248.631605:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbefb80 x1876718314896384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778248.631623:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314896384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778248.631854:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314896640:0@lo:400:kworker.0 00000100:00100000:0.0:1789778248.631963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778248.631982:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314896768:0@lo:400:kworker.0 00000100:00100000:0.0:1789778248.631996:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896640 00000100:00100000:0.0:1789778248.631999:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896640 00000100:00100000:1.0:1789778248.632010:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778248.632024:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896768 00000100:00100000:0.0:1789778248.632027:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896768 00000100:00100000:0.0:1789778248.632050:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789778248.632056:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314896640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778248.632117:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314896640:12345-0@lo:400:kworker.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778248.632123:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789778248.632135:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789778248.632141:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314896768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778248.632169:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314896768:12345-0@lo:400:kworker.0 Request processed in 29us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778248.632175:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789778248.632198:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314896640:0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632421:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314896512:0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632453:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778248.632478:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314897024:0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632500:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778248.632515:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314896768:0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632518:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778248.632523:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314896896:0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632545:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778248.632579:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896896 00000100:00100000:2.0:1789778248.632583:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896896 00000100:00100000:2.0:1789778248.632610:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789778248.632616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314896896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632661:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314896896:12345-0@lo:400:kworker.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778248.632667:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789778248.632682:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778248.632691:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314896512 00000100:00100000:2.0:1789778248.632694:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314896512 00000100:00100000:2.0:1789778248.632726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789778248.632733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314896512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632764:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314896512:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778248.632770:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789778248.632797:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314897024 00000100:00100000:2.0:1789778248.632800:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314897024 00000100:00100000:2.0:1789778248.632837:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789778248.632839:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778248.632843:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314897024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632884:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314897024:12345-0@lo:400:kworker.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778248.632891:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789778248.632937:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314896896:0@lo:400:kworker.0 00000100:00100000:2.0:1789778248.632947:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314896512:0@lo:400:kworker.0 00010000:00080000:2.0:1789778248.632956:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfb65500 x1876718314897024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778248.632965:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314897024:0@lo:400:kworker.0 00000100:00100000:2.0:1789778249.144502:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778249.144528:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314897152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778249.144683:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778249.144756:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314897152 00000100:00100000:2.0:1789778249.144764:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314897152 00000100:00100000:2.0:1789778249.144807:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789778249.144815:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314897152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778249.144863:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778249.144909:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314897152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778249.144917:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789778249.144969:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f7b80 x1876718314897152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778249.145000:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314897152:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789778249.223337:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14c48d7e-8983-41f6-9a41-ddf92e2ec256 00000020:00000080:0.0:1789778249.223360:0:6716:0:(genops.c:885:class_export_put()) final put ffff9b3ec1642000/14c48d7e-8983-41f6-9a41-ddf92e2ec256 00000020:00000080:2.0:1789778249.223490:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec1642000/14c48d7e-8983-41f6-9a41-ddf92e2ec256 for lustre-OST0000 00000020:00000080:2.0:1789778249.223538:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ec1645000 for lustre-OST0000 00010000:00010000:1.0:1789778249.405045:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778249.486808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778249.486851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778249.486936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778249.486966:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988352 00000100:00100000:2.0:1789778249.486975:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988352 00000100:00100000:2.0:1789778249.487037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:2.0:1789778249.487048:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295988352:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778249.487152:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295988352:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778249.487160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:2.0:1789778249.487195:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988480 00000100:00100000:2.0:1789778249.487199:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988480 00000100:00100000:2.0:1789778249.487232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988608 00000100:00100000:2.0:1789778249.487235:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988608 00000100:00100000:2.0:1789778249.487256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:2.0:1789778249.487262:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295988480:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778249.487292:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718295988480:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778249.487299:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:2.0:1789778249.487311:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:2.0:1789778249.487315:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295988608:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778249.487336:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295988608:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 20us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778249.487340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00080000:2.0:1789778249.487446:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789778250.417592:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778251.441599:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789778252.142276:0:11166:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4e7e7e00 20000000:00000080:2.0:1789778252.142294:0:11166:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3ebf30d400 uarg=0000000000000000 20000000:01000000:2.0:1789778252.142330:0:11166:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789778252.142336:0:11166:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789778252.142340:0:11166:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789778252.143374:0:11167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789778252.143531:0:11166:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789778252.149008:0:11166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789778252.149199:0:11166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149219:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149226:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149234:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149242:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149249:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149257:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149302:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149316:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 12 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.149344:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897280:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778252.149456:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149466:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 12 pid: 5839 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.149475:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897408:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778252.149507:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149515:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 18 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.149524:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897536:0@lo:104: 00000100:00100000:2.0:1789778252.149563:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789778252.149606:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149613:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 18 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.149621:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897664:0@lo:104: 00000100:00100000:2.0:1789778252.149640:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789778252.149659:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.149666:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 18 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.149680:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897792:0@lo:104: 00000100:00100000:2.0:1789778252.149699:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778252.149708:0:11166:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88e71780 going to sleep for 11 seconds 00000100:00100000:1.0:1789778252.150131:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314897536 00000100:00100000:1.0:1789778252.150140:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314897536 00000100:00100000:1.0:1789778252.150184:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314897664 00000100:00100000:1.0:1789778252.150189:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314897664 00000100:00100000:1.0:1789778252.150198:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314897792 00000100:00100000:1.0:1789778252.150200:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314897792 00000100:00100000:1.0:1789778252.150213:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789778252.150221:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:11166:x1876718314897536:12345-0@lo:104: 00010000:00010000:1.0:1789778252.150234:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150290:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789778252.150296:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:11166:x1876718314897536:12345-0@lo:104: Request processed in 76us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778252.150311:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789778252.150329:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778252.150334:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:11166:x1876718314897664:12345-0@lo:104: 00010000:00010000:1.0:1789778252.150341:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150374:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789778252.150379:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:11166:x1876718314897664:12345-0@lo:104: Request processed in 45us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778252.150384:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789778252.150395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789778252.150401:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:11166:x1876718314897792:12345-0@lo:104: 00010000:00010000:1.0:1789778252.150408:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150433:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789778252.150437:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:11166:x1876718314897792:12345-0@lo:104: Request processed in 38us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778252.150442:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789778252.150457:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789778252.150462:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150469:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f000 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778252.150473:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150490:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778252.150497:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778252.150503:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789778252.150530:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150536:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778252.150555:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150561:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f000/0x5a1e1c1157440dc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440dce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150585:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778252.150588:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150594:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150ee00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778252.150596:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150602:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778252.150607:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778252.150619:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789778252.150632:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150638:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778252.150652:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150658:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ee00/0x5a1e1c1157440db9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440dc0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150667:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778252.150670:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150676:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321e00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778252.150679:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150685:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778252.150691:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778252.150695:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789778252.150706:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150711:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778252.150724:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150731:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3d82321e00/0x5a1e1c1157440dab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440db2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.150744:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778252.150746:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778252.150748:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778252.150754:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778252.150764:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314897920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778252.150795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778252.150832:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314898048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778252.150853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778252.150868:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778252.150874:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314898176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778252.150890:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778252.150914:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314897920 00000100:00100000:1.0:1789778252.150918:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314897920 00010000:00010000:1.0:1789778252.150935:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 19 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778252.150948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898048 00000100:00100000:1.0:1789778252.150950:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898048 00010000:00010000:1.0:1789778252.150958:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 20 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778252.150967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898176 00000100:00100000:1.0:1789778252.150970:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898176 00010000:00010000:1.0:1789778252.150978:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 21 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778252.150999:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778252.151005:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88caf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+21:3311:x1876718314897920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778252.151014:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778252.151019:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 21 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.151027:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 21 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.151042:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778252.151089:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88caf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+21:3311:x1876718314897920:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778252.151095:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778252.151130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789778252.151136:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+20:3312:x1876718314898048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778252.151142:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778252.151146:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 20 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.151154:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 20 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.151163:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778252.151185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+20:3312:x1876718314898048:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778252.151190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789778252.151201:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789778252.151212:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314898176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778252.151219:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778252.151224:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 19 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.151232:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 19 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.151240:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778252.151259:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314898176:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778252.151265:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789778252.151291:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314897920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778252.151310:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314898176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778252.151317:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314898048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778252.157596:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150f600/0x5a1e1c1157440dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440dc7 expref: 18 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.157617:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897536:0@lo:104: 00010000:00010000:2.0:1789778252.157631:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440dc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440db9 expref: 17 pid: 5840 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.157639:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897664:0@lo:104: 00010000:00010000:2.0:1789778252.157648:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657400/0x5a1e1c1157440db2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440dab expref: 16 pid: 5841 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.157655:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897792:0@lo:104: 00000100:00100000:0.0:1789778252.158719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778252.158794:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988736 00000100:00100000:1.0:1789778252.158804:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988736 00010000:00010000:1.0:1789778252.158843:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 13 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778252.158889:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:1.0:1789778252.158898:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295988736:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778252.158913:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778252.158918:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 13 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.158929:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 13 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778252.158963:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778252.159026:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295988736:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 128us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778252.159034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00010000:00010000:2.0:1789778252.159469:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657000/0x5a1e1c1157440dea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7acd expref: 12 pid: 5840 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778252.159485:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897280:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778252.159497:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1876718314897408:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778252.159531:0:11166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778252.160559:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778252.160794:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988864 00000100:00100000:3.0:1789778252.160804:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988864 00010000:00010000:3.0:1789778252.160841:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 12 pid: 5839 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778252.160970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:3.0:1789778252.160980:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:2372:x1876718295988864:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778252.160997:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778252.161004:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 12 pid: 5839 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161016:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 12 pid: 5839 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161034:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440dd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a95 expref: 12 pid: 5839 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161094:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161103:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161118:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161126:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161133:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161140:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161146:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778252.161149:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161157:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161171:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778252.161181:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778252.161304:0:11166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.161311:0:11166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778252.161324:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657800/0x5a1e1c1157440e06 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778252.162336:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+11:2372:x1876718295988864:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1353us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778252.162351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00010000:00010000:1.0:1789778252.465715:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778253.468712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778253.469477:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295988992 00000100:00100000:2.0:1789778253.469488:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295988992 00000100:00100000:2.0:1789778253.469556:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:2.0:1789778253.469568:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+11:5629:x1876718295988992:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778253.469595:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778253.469614:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7af7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778253.469643:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778253.469662:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778253.469672:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656800, rc 0) 00000100:00100000:2.0:1789778253.469785:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295988992:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 219us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778253.469793:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:1.0:1789778253.480435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778253.480678:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295989120 00000100:00100000:3.0:1789778253.480690:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295989120 00000100:00100000:3.0:1789778253.480752:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 231 00000100:00100000:3.0:1789778253.480763:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295989120:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778253.481088:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295989120:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 302us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778253.481097:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 231 00000100:00100000:0.0:1789778253.487423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778253.487493:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295989248 00000100:00100000:2.0:1789778253.487503:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295989248 00000100:00100000:2.0:1789778253.487559:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00100000:2.0:1789778253.487570:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295989248:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778253.487809:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295989248:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 241us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778253.487824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 232 00010000:00010000:2.0:1789778253.489908:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778253.500418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778253.500539:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295989376 00000100:00100000:3.0:1789778253.500560:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295989376 00000100:00100000:3.0:1789778253.500617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:3.0:1789778253.500628:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295989376:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778253.500650:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778253.500677:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7afe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778253.500706:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778253.500717:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778253.500726:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f800, rc 0) 00000100:00100000:3.0:1789778253.500786:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295989376:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 160us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778253.500794:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:3.0:1789778253.519156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778253.519349:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295989504 00000100:00100000:2.0:1789778253.519361:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295989504 00000100:00100000:2.0:1789778253.519406:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:2.0:1789778253.519415:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295989504:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778253.521459:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295989504:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 2037us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778253.521472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:3.0:1789778253.532218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778253.533784:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295989632 00000100:00100000:3.0:1789778253.533798:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295989632 00000100:00100000:3.0:1789778253.533912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 235 00000100:00100000:3.0:1789778253.533922:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295989632:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778253.538318:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295989632:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 4387us (6100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778253.538332:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 235 00000100:00100000:3.0:1789778253.745297:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789778253.746110:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314898432:0@lo:400:kworker.0 00000100:00100000:3.0:1789778253.746251:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778253.746307:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314898304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778253.746338:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778253.746378:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898304 00000100:00100000:3.0:1789778253.746386:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898304 00000100:00100000:3.0:1789778253.746440:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789778253.746449:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314898304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778253.746483:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778253.746528:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314898304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778253.746535:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789778253.746640:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898432 00000100:00100000:2.0:1789778253.746645:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898432 00000100:00100000:2.0:1789778253.746688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789778253.746695:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3311:x1876718314898432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778253.746729:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3311:x1876718314898432:12345-0@lo:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778253.746735:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:2.0:1789778253.746783:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778253.746810:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314898432:0@lo:400:kworker.0 00010000:00080000:2.0:1789778253.746824:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb581fb80 x1876718314898304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778253.746852:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314898304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778253.749266:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314898560:0@lo:400:kworker.0 00000100:00100000:2.0:1789778253.749366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778253.749479:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314898688:0@lo:400:kworker.0 00000100:00100000:1.0:1789778253.749509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778253.751307:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898560 00000100:00100000:3.0:1789778253.751320:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898560 00000100:00100000:3.0:1789778253.751374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898688 00000100:00100000:3.0:1789778253.751377:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898688 00000100:00100000:3.0:1789778253.751411:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789778253.751432:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314898560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778253.756097:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789778253.756123:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314898688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778253.756241:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314898688:12345-0@lo:400:kworker.0 Request processed in 131us (6731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778253.756248:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789778253.756285:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314898816:0@lo:400:kworker.0 00000100:00100000:0.0:1789778253.756318:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778253.756343:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778253.756349:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314898944:0@lo:400:kworker.0 00000100:00100000:0.0:1789778253.756389:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778253.756423:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898816 00000100:00100000:0.0:1789778253.756430:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898816 00000100:00100000:0.0:1789778253.756457:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789778253.756462:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314898816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778253.756492:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314898816:12345-0@lo:400:kworker.0 Request processed in 29us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778253.756497:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789778253.756526:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314898816:0@lo:400:kworker.0 00000100:00100000:1.0:1789778253.756914:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314898688:0@lo:400:kworker.0 00000100:00100000:3.0:1789778253.758978:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314898560:12345-0@lo:400:kworker.0 Request processed in 7540us (9603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778253.759001:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789778253.759047:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778253.759099:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314898944 00000100:00100000:3.0:1789778253.759107:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314898944 00000100:00100000:3.0:1789778253.759163:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789778253.759172:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314898944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778253.759254:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314898944:12345-0@lo:400:kworker.0 Request processed in 82us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778253.759261:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789778253.759303:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfb67100 x1876718314898944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778253.759317:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314898944:0@lo:400:kworker.0 00000100:00080000:0.0:1789778253.760083:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778253.762482:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314898560:0@lo:400:kworker.0 10000000:01000000:0.0:1789778254.067998:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789778254.068007:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ebf7c9000 from 7 10000000:01000000:0.0:1789778254.068013:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778254.068061:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.068099:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.068112:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778254.068139:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.068224:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778254.068278:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9075e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789778254.068302:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899072 00000100:00100000:0.0:1789778254.068309:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899072 00000100:00100000:0.0:1789778254.068397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789778254.068407:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314899072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778254.068421:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778254.068433:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440e1b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.068456:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.068466:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.068474:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757200, rc 0) 00000100:00100000:0.0:1789778254.068513:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314899072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778254.068519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789778254.068580:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778254.068595:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.068604:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778254.068655:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.068680:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778254.068695:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9075e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789778254.068707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899200 00000100:00100000:0.0:1789778254.068711:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899200 00000100:00100000:0.0:1789778254.068732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789778254.068737:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314899200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.069312:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314899200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 572us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778254.069319:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789778254.069368:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.069397:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.069436:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778254.069449:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9075e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789778254.069461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899328 00000100:00100000:0.0:1789778254.069464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899328 00000100:00100000:0.0:1789778254.069486:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789778254.069492:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314899328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.069638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314899328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778254.069651:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789778254.069691:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789778254.070902:0:11249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789778254.070958:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789778254.071038:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789778254.071051:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.071061:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778254.071175:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789778254.071177:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ec0d89800 from 7 10000000:01000000:0.0:1789778254.071248:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778254.071285:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.071293:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.071304:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778254.071324:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.071442:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778254.071474:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789778254.071490:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899456 00000100:00100000:0.0:1789778254.071496:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899456 00000100:00100000:0.0:1789778254.071531:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789778254.071563:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314899456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778254.071576:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778254.071588:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440e29 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.071610:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.071620:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.071628:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757800, rc 0) 00000100:00100000:0.0:1789778254.071662:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314899456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778254.071669:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789778254.071712:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778254.071726:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778254.071734:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778254.072093:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778254.072121:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778254.072256:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90931d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778254.073278:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899584 00000100:00100000:3.0:1789778254.073286:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899584 00000100:00100000:2.0:1789778254.075925:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789778254.075938:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314899584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778254.076845:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314899584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 905us (4718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778254.076855:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789778254.077018:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778254.077086:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778254.077143:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778254.080875:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899712 00000100:00100000:3.0:1789778254.080889:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899712 00000100:00100000:3.0:1789778254.080950:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789778254.080961:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314899712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778254.081210:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314899712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778254.081218:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789778254.081950:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778254.081977:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789778254.084449:0:11250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789778254.084556:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789778254.084575:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778254.084587:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.084608:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778254.084618:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789778254.084621:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3eabbad800 from 7 10000000:01000000:3.0:1789778254.084624:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789778254.084659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.084666:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.084675:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778254.084698:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789778254.084769:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778254.084808:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941840 going to sleep for 11 seconds 00000100:00100000:3.0:1789778254.084827:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899840 00000100:00100000:3.0:1789778254.084833:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899840 00000100:00100000:3.0:1789778254.084873:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789778254.084882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314899840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778254.084895:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778254.084908:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440e37 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.084932:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.084952:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.084960:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150e200, rc 0) 00000100:00100000:3.0:1789778254.085009:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314899840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778254.085016:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789778254.085061:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778254.085094:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.085102:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778254.085148:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778254.085171:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778254.085197:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941840 going to sleep for 11 seconds 00000100:00100000:3.0:1789778254.085210:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314899968 00000100:00100000:3.0:1789778254.085213:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314899968 00000100:00100000:3.0:1789778254.085234:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789778254.085240:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314899968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778254.085462:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314899968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778254.085469:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789778254.085497:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314899968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778254.085530:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314900096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778254.085575:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778254.085587:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf941840 going to sleep for 11 seconds 00000100:00100000:3.0:1789778254.085599:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900096 00000100:00100000:3.0:1789778254.085602:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900096 00000100:00100000:3.0:1789778254.085623:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789778254.085628:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314900096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778254.085756:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314900096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778254.085763:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789778254.085799:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314900096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789778254.091847:0:11251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789778254.092245:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789778254.092264:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778254.092276:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778254.092288:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778254.258638:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d813f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314900224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778254.258710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778254.258786:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900224 00000100:00100000:1.0:1789778254.258793:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900224 00000100:00100000:1.0:1789778254.258838:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789778254.258848:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314900224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789778254.258881:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778254.258922:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314900224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778254.258928:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789778254.258958:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d813f7100 x1876718314900224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778254.259109:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d813f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314900224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778254.513790:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778254.611893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778254.611935:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778254.611972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778254.612019:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295989888 00000100:00100000:0.0:1789778254.612029:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295989888 00000100:00100000:0.0:1789778254.612108:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295990016 00000100:00100000:0.0:1789778254.612112:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295990016 00000100:00100000:0.0:1789778254.612134:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:0.0:1789778254.612145:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295989888:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778254.612328:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1789778254.612338:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295990016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778254.612397:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295990016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 61us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778254.612404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:3.0:1789778254.613401:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295989760 00000100:00100000:3.0:1789778254.613411:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295989760 00000100:00100000:3.0:1789778254.613461:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 246 00000100:00100000:3.0:1789778254.613470:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718295989760:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778254.613524:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718295989760:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 55us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778254.613541:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 246 00000100:00100000:0.0:1789778254.614959:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718295989888:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 2810us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778254.614970:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00080000:0.0:1789778254.614997:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789778255.537629:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789778256.228484:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789778256.564875:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778257.595121:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778258.609419:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778258.867738:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314900352:0@lo:400:kworker.0 00000100:00100000:1.0:1789778258.867827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778258.867881:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314900864:0@lo:400:kworker.0 00000100:00100000:1.0:1789778258.867921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778258.867946:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778258.868350:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900864 00000100:00100000:2.0:1789778258.868359:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900864 00000100:00100000:2.0:1789778258.868414:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789778258.868424:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314900864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778258.868491:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314900864:12345-0@lo:400:kworker.0 Request processed in 68us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778258.868498:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789778258.868709:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314900736:0@lo:400:kworker.0 00000100:00100000:1.0:1789778258.868745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778258.868799:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314900864:0@lo:400:kworker.0 00000100:00100000:0.0:1789778258.869101:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314900608:0@lo:400:kworker.0 00000100:00100000:0.0:1789778258.869143:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778258.869163:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789778258.869169:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314900480:0@lo:400:kworker.0 00000100:00100000:0.0:1789778258.869191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778258.869209:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314900992:0@lo:400:kworker.0 00000100:00100000:0.0:1789778258.869229:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789778258.869250:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778258.869275:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900608 00000100:00100000:0.0:1789778258.869279:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900608 00000100:00100000:0.0:1789778258.869308:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900480 00000100:00100000:0.0:1789778258.869311:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900480 00000100:00100000:0.0:1789778258.869837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789778258.869845:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314900608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778258.869903:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314900608:12345-0@lo:400:kworker.0 Request processed in 58us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778258.869910:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789778258.869937:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789778258.869943:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314900480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778258.870135:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314900480:12345-0@lo:400:kworker.0 Request processed in 190us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778258.870142:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1789778258.870162:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778258.870185:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314900480:0@lo:400:kworker.0 00000100:00100000:0.0:1789778258.870195:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314900608:0@lo:400:kworker.0 00000100:00100000:2.0:1789778258.870494:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900736 00000100:00100000:2.0:1789778258.870499:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900736 00000100:00100000:2.0:1789778258.870540:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900992 00000100:00100000:2.0:1789778258.870543:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900992 00000100:00100000:2.0:1789778258.870562:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789778258.870569:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314900736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778258.870616:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314900736:12345-0@lo:400:kworker.0 Request processed in 47us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778258.870622:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789778258.870634:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789778258.870640:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314900992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778258.870669:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314900992:12345-0@lo:400:kworker.0 Request processed in 30us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778258.870685:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789778258.870899:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778258.870909:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314901120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778258.870944:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778258.870992:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314900352 00000100:00100000:3.0:1789778258.870997:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314900352 00000100:00100000:3.0:1789778258.871023:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789778258.871030:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314900352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778258.871061:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314900352:12345-0@lo:400:kworker.0 Request processed in 31us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778258.871092:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789778258.871519:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314901120 00000100:00100000:2.0:1789778258.871524:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314901120 00000100:00100000:2.0:1789778258.871560:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789778258.871567:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314901120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778258.871598:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778258.871637:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314901120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778258.871642:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789778258.871807:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec700 x1876718314900736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778258.871820:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314900736:0@lo:400:kworker.0 00000100:00100000:1.0:1789778258.871831:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314900352:0@lo:400:kworker.0 00000100:00080000:0.0:1789778258.872590:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789778258.872596:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789778258.872624:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec16d0000 x1876718314900992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778258.872634:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314900992:0@lo:400:kworker.0 00010000:00080000:3.0:1789778258.872731:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e909c4700 x1876718314901120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778258.872747:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314901120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778259.378020:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314901248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778259.378232:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778259.378325:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314901248 00000100:00100000:2.0:1789778259.378333:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314901248 00000100:00100000:2.0:1789778259.378381:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789778259.378391:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314901248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778259.378424:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778259.379018:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314901248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 627us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.379027:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789778259.380415:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e909c4700 x1876718314901248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778259.380449:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314901248:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789778259.545542:0:11465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:37:38 (1789778258) === 00010000:00010000:1.0:1789778259.633412:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778259.727620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778259.727656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778259.727677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.727835:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295990272 00000100:00100000:2.0:1789778259.727845:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295990272 00000100:00100000:2.0:1789778259.727900:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295990400 00000100:00100000:2.0:1789778259.727902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295990400 00000100:00100000:2.0:1789778259.727915:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:2.0:1789778259.727922:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718295990272:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778259.727978:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718295990272:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 57us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.727984:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:2.0:1789778259.727995:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:2.0:1789778259.727998:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295990400:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778259.728012:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295990400:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 13us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.728015:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:3.0:1789778259.728364:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295990144 00000100:00100000:3.0:1789778259.728368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295990144 00000100:00100000:3.0:1789778259.728452:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 248 00000100:00100000:3.0:1789778259.728460:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295990144:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778259.728488:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295990144:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778259.728494:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 248 00000100:00080000:1.0:1789778259.729246:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778259.742741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778259.742827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.742965:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295990528 00000100:00100000:2.0:1789778259.742975:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295990528 00000100:00100000:2.0:1789778259.743034:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1789778259.743045:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295990528:12345-192.168.201.45@tcp:41:mkdir.0 00000004:00000024:2.0:1789778259.743120:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789778259.743211:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718295990528:12345-192.168.201.45@tcp:41:mkdir.0 Request processed in 167us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.743218:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1789778259.743816:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295990656 00000100:00100000:3.0:1789778259.743823:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295990656 00000100:00100000:3.0:1789778259.743874:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:3.0:1789778259.743883:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:9714:x1876718295990656:12345-192.168.201.45@tcp:700:mkdir.0 00000100:00100000:3.0:1789778259.743937:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:9714:x1876718295990656:12345-192.168.201.45@tcp:700:mkdir.0 Request processed in 55us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778259.743945:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1789778259.745737:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778259.745824:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295990912 00000100:00100000:3.0:1789778259.745833:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295990912 00000100:00100000:3.0:1789778259.745903:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778259.745911:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:9714:x1876718295990912:12345-192.168.201.45@tcp:36:mkdir.0 00010000:00010000:3.0:1789778259.745955:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778259.745978:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e400/0x5a1e1c1157440d26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a80 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.745992:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e82bb5000) 00010000:00010000:3.0:1789778259.746001:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778259.746335:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.746349:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.746358:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.746831:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.746842:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.746852:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778259.748013:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789778259.748024:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.748030:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.748034:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.748038:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.748041:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.748046:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.748055:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e82bb5c00) 00010000:00010000:2.0:1789778259.748057:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.748059:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.748096:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c1157440e45 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778259.748113:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a14d71c reply state 00000000361d0e9e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778259.748121:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778259.748370:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:9714:x1876718295990912:12345-192.168.201.45@tcp:36:mkdir.0 Request processed in 2455us (2636us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789778259.748387:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:3.0:1789778259.750904:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.750922:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.750945:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.750951:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778259.750955:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.750963:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.750978:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b3e922c1b00) 00010000:00010000:3.0:1789778259.750980:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778259.750984:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.750990:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e4c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778259.756873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.756968:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295991040 00000100:00100000:2.0:1789778259.756978:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295991040 00000100:00100000:2.0:1789778259.757108:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1789778259.757119:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:9715:x1876718295991040:12345-192.168.201.45@tcp:101:chmod.0 00010000:00010000:2.0:1789778259.757142:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778259.757164:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b05 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.757229:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440e5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.757243:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.757255:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778259.757288:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778259.757292:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778259.757328:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.757354:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b05 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.757369:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b05 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.757389:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1700) 00010000:00010000:2.0:1789778259.757392:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778259.757394:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657000, rc 0) 00000100:00100000:2.0:1789778259.757457:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:9715:x1876718295991040:12345-192.168.201.45@tcp:101:chmod.0 Request processed in 340us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.757469:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1789778259.760174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778259.760536:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295991296 00000100:00100000:0.0:1789778259.760547:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295991296 00000100:00100000:1.0:1789778259.760713:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1789778259.760722:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:9715:x1876718295991296:12345-192.168.201.45@tcp:36:chmod.0 00010000:00010000:1.0:1789778259.760772:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778259.760799:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440e5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b05 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.760818:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1700) 00010000:00010000:1.0:1789778259.760829:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778259.760853:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.760863:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.760870:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789778259.761145:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca3ff818 reply state 0000000011e8898d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778259.761155:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789778259.761163:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789778259.761254:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:9715:x1876718295991296:12345-192.168.201.45@tcp:36:chmod.0 Request processed in 532us (1087us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789778259.761261:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00010000:00010000:2.0:1789778259.767012:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.767031:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.767040:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.767046:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.767050:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.767058:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.767748:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e91b87200) 00010000:00010000:2.0:1789778259.767752:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789778259.767757:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.767764:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440e61 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778259.783670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.783827:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295991424 00000100:00100000:2.0:1789778259.783837:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295991424 00000100:00100000:2.0:1789778259.783898:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1789778259.783909:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:9716:x1876718295991424:12345-192.168.201.45@tcp:101:chown.0 00010000:00010000:2.0:1789778259.783933:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778259.783956:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b0c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.784013:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157440e6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.784023:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157440e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.784032:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157440e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778259.784058:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778259.784060:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778259.784137:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157440e6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.784162:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b0c expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.784179:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157440e6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b0c expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.784188:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778259.784203:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778259.784207:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657800, rc 0) 00000100:00100000:2.0:1789778259.784255:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:9716:x1876718295991424:12345-192.168.201.45@tcp:101:chown.0 Request processed in 347us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.784262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:1.0:1789778259.786856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778259.786940:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295991552 00000100:00100000:0.0:1789778259.786950:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295991552 00000100:00100000:0.0:1789778259.787000:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1789778259.787009:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:9716:x1876718295991552:12345-192.168.201.45@tcp:101:chown.0 00010000:00010000:0.0:1789778259.787031:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778259.787094:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757000/0x5a1e1c1157440e76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b13 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787155:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787168:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787179:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787194:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787201:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787207:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787291:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787299:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787306:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778259.787335:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789778259.787339:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778259.787358:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787375:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787380:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787386:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787392:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778259.787395:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787401:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787646:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778259.787649:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778259.787653:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787657:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787667:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787670:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787674:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787682:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778259.787684:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787687:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787692:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b3ea4c7a000) 00010000:00010000:0.0:1789778259.787693:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778259.787694:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787697:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440e84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787720:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757000/0x5a1e1c1157440e76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b13 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787729:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b13 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.787734:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778259.787736:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778259.787738:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757e00, rc 0) 00000100:00100000:0.0:1789778259.787801:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:9716:x1876718295991552:12345-192.168.201.45@tcp:101:chown.0 Request processed in 792us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778259.787808:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1789778259.789986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.790053:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295991808 00000100:00100000:2.0:1789778259.790060:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295991808 00000100:00100000:2.0:1789778259.790290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1789778259.790301:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:9716:x1876718295991808:12345-192.168.201.45@tcp:36:chown.0 00010000:00010000:2.0:1789778259.790350:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778259.790371:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440e8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b13 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.790381:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:2.0:1789778259.790388:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778259.790405:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.790424:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.790430:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778259.815952:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2073c09 reply state 0000000044d0d2e0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778259.815967:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789778259.815980:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789778259.816109:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:9716:x1876718295991808:12345-192.168.201.45@tcp:36:chown.0 Request processed in 25806us (26124us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789778259.816119:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000001:00080000:1.0:1789778259.816199:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1789778259.816223:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1789778259.816460:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.816484:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.816492:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.816498:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778259.816502:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.816509:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.816524:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1800) 00010000:00010000:3.0:1789778259.816527:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789778259.816531:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.816536:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440e92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778259.831430:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.831641:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295991936 00000100:00100000:2.0:1789778259.831651:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295991936 00000100:00100000:2.0:1789778259.831709:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1789778259.831720:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:9717:x1876718295991936:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:2.0:1789778259.831745:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778259.831778:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b1a expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789778259.835503:0:8093:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3674us 00010000:00010000:2.0:1789778259.842920:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.842937:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.842946:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.842955:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.842960:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.842964:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843277:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157440eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843285:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157440eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843292:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157440eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778259.843313:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778259.843326:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778259.843363:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157440eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843376:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843381:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843386:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843389:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.843392:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843397:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843405:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778259.843415:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.843420:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843425:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c1157440ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843442:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843449:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843454:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843465:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.843468:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843475:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843482:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778259.843483:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.843485:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843489:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157440ea7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843517:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657c00/0x5a1e1c1157440e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b1a expref: 8 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843525:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157440eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b1a expref: 7 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.843530:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:2.0:1789778259.843531:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789778259.843533:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9000, rc 0) 00000100:00100000:2.0:1789778259.843600:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:9717:x1876718295991936:12345-192.168.201.45@tcp:101:touch.500 Request processed in 11882us (12189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.843606:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1789778259.846540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778259.846602:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295992192 00000100:00100000:1.0:1789778259.846611:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295992192 00000100:00100000:1.0:1789778259.846656:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1789778259.846663:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:9717:x1876718295992192:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:1.0:1789778259.846679:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778259.846694:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440eb5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b21 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.846923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.846933:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.846941:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.846995:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.847000:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.847004:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789778259.847981:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789778259.848520:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440eca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848536:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848543:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848570:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848575:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848580:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848583:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778259.848586:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848590:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848599:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:1.0:1789778259.848601:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778259.848604:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848607:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157440ebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789778259.848615:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091b9439c reply state 00000000497c5f6c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778259.848625:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789778259.848652:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440eb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b21 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848660:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b21 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778259.848665:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3e91b87800) 00010000:00010000:1.0:1789778259.848667:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778259.848668:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320200, rc 0) 00000100:00100000:1.0:1789778259.848811:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:9717:x1876718295992192:12345-192.168.201.45@tcp:101:touch.500 Request processed in 2146us (2278us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789778259.848820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00010000:00010000:2.0:1789778259.850447:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.850473:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.850480:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.850485:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.850490:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.850498:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.850512:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x25480f0f (ffff9b3e91b87c00) 00010000:00010000:2.0:1789778259.850515:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.850519:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.850524:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440ec3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778259.852903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778259.853054:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295992448 00000100:00100000:0.0:1789778259.853248:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295992448 00000100:00100000:0.0:1789778259.853341:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:0.0:1789778259.853352:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:9717:x1876718295992448:12345-192.168.201.45@tcp:36:touch.500 00010000:00010000:0.0:1789778259.853402:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778259.853447:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440eca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b21 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.853463:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3e91b87800) 00010000:00010000:0.0:1789778259.853474:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789778259.853512:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.853522:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.853528:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789778259.853625:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2656952 reply state 00000000dd4cf40f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778259.853631:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789778259.853707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:9717:x1876718295992448:12345-192.168.201.45@tcp:36:touch.500 Request processed in 358us (815us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789778259.853712:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00010000:00010000:3.0:1789778259.855323:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.855337:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.855361:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.855367:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778259.855373:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.855380:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.855394:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:3.0:1789778259.855397:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778259.855401:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.855407:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440ed8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778259.856025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.859765:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295992576 00000100:00100000:2.0:1789778259.859783:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295992576 00000100:00100000:2.0:1789778259.859848:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:2.0:1789778259.859856:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:9717:x1876718295992576:12345-192.168.201.45@tcp:101:touch.500 00010000:00010000:2.0:1789778259.859889:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778259.859907:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157440edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b28 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.859972:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157440edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b28 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.859983:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157440edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b28 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.859995:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778259.859998:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789778259.860000:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9600, rc 0) 00000100:00100000:2.0:1789778259.860164:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:9717:x1876718295992576:12345-192.168.201.45@tcp:101:touch.500 Request processed in 307us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.860172:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:0.0:1789778259.862961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.863391:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295992704 00000100:00100000:2.0:1789778259.863400:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295992704 00000100:00100000:2.0:1789778259.863463:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1789778259.863471:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2371:x1876718295992704:12345-192.168.201.45@tcp:8:touch.500 00010000:00080000:2.0:1789778259.863502:0:8205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:2.0:1789778259.863527:0:8205:0:(genops.c:1385:class_connect()) connect: client bdd103b9-ae1a-4bf0-9cc3-bcece875c39a, cookie 0x5a1e1c1157440ee6 00002000:00100000:2.0:1789778259.863536:0:8205:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bdd103b9-ae1a-4bf0-9cc3-bcece875c39a/ffff9b3ebfe31000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789778259.863544:0:8205:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789778259.863717:0:8205:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789778259.863751:0:8205:0:(import.c:65:import_set_state_nolock()) ffff9b3ebfe32800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778259.863822:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2371:x1876718295992704:12345-192.168.201.45@tcp:8:touch.500 Request processed in 350us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.863842:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:0.0:1789778259.865849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778259.865925:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295992832 00000100:00100000:3.0:1789778259.865935:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295992832 00000100:00100000:3.0:1789778259.865998:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:3.0:1789778259.866008:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:0:x1876718295992832:12345-192.168.201.45@tcp:2:touch.500 00000100:00080000:1.0:1789778259.866655:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778259.888940:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:0:x1876718295992832:12345-192.168.201.45@tcp:2:touch.500 Request processed in 22924us (23087us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789778259.888959:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000001:00100000:1.0:1789778259.889050:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000001:00080000:1.0:1789778259.889087:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1789778259.891496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778259.891563:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295993088 00000100:00100000:3.0:1789778259.891572:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295993088 00000100:00100000:3.0:1789778259.891614:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1789778259.891621:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:9717:x1876718295993088:12345-192.168.201.45@tcp:35:touch.500 00000100:00100000:3.0:1789778259.891919:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:9717:x1876718295993088:12345-192.168.201.45@tcp:35:touch.500 Request processed in 298us (434us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789778259.891935:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1789778259.913862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.914001:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295993216 00000100:00100000:2.0:1789778259.914011:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295993216 00000100:00100000:2.0:1789778259.914059:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:2.0:1789778259.914185:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:9718:x1876718295993216:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:2.0:1789778259.914211:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778259.914232:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157440eed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b2f expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.914302:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157440ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.914316:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157440ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.914327:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157440ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778259.914361:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778259.914365:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778259.914399:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157440ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.914425:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157440eed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b2f expref: 13 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.914450:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157440ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b2f expref: 12 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.914478:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:2.0:1789778259.914481:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778259.914485:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8c00, rc 0) 00000100:00100000:2.0:1789778259.916844:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:9718:x1876718295993216:12345-192.168.201.45@tcp:101:rm.0 Request processed in 2765us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.916857:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1789778259.922119:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.923646:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295993472 00000100:00100000:2.0:1789778259.923659:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295993472 00000100:00100000:2.0:1789778259.923714:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:2.0:1789778259.923723:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:9718:x1876718295993472:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:2.0:1789778259.923746:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778259.923765:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157440efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b36 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778259.923852:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789778259.923997:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157440efb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b36 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.924009:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778259.924011:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778259.924015:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157440efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b36 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.924023:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8600, rc 0) 00000100:00100000:2.0:1789778259.924107:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:9718:x1876718295993472:12345-192.168.201.45@tcp:101:rm.0 Request processed in 384us (2049us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789778259.924123:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1789778259.929822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778259.929912:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295993600 00000100:00100000:3.0:1789778259.929924:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295993600 00000100:00100000:3.0:1789778259.929981:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:3.0:1789778259.929992:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:9718:x1876718295993600:12345-192.168.201.45@tcp:37:rm.0 00000100:00100000:0.0:1789778259.938597:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:9718:x1876718295993600:12345-192.168.201.45@tcp:37:rm.0 Request processed in 8594us (8773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778259.938613:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1789778259.942399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778259.942550:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295993856 00000100:00100000:0.0:1789778259.942561:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295993856 00000100:00100000:0.0:1789778259.942620:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:0.0:1789778259.942630:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:9718:x1876718295993856:12345-192.168.201.45@tcp:35:rm.0 00000100:00100000:0.0:1789778259.943386:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e867b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:9718:x1876718295993856:12345-192.168.201.45@tcp:35:rm.0 Request processed in 754us (1140us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789778259.943396:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:3.0:1789778259.946325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778259.946427:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295994112 00000100:00100000:0.0:1789778259.946444:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295994112 00000100:00100000:0.0:1789778259.946504:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:0.0:1789778259.946514:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:9718:x1876718295994112:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:0.0:1789778259.946537:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778259.946558:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.946652:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757000/0x5a1e1c1157440f10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.946666:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757000/0x5a1e1c1157440f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.946697:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757000/0x5a1e1c1157440f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778259.946710:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789778259.946850:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b3d expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.946868:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757000/0x5a1e1c1157440f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b3d expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.946877:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:0.0:1789778259.946880:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789778259.946884:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757000, rc 0) 00000100:00100000:0.0:1789778259.946947:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:9718:x1876718295994112:12345-192.168.201.45@tcp:101:rm.0 Request processed in 434us (632us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789778259.946954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:3.0:1789778259.949946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778259.950049:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295994240 00000100:00100000:1.0:1789778259.950060:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295994240 00000100:00100000:1.0:1789778259.950173:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:1.0:1789778259.950183:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:9718:x1876718295994240:12345-192.168.201.45@tcp:41:rm.0 00000004:00000024:1.0:1789778259.950241:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789778259.950317:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:9718:x1876718295994240:12345-192.168.201.45@tcp:41:rm.0 Request processed in 135us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778259.950325:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:1.0:1789778259.958828:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.959003:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295994368 00000100:00100000:2.0:1789778259.959013:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295994368 00000100:00100000:2.0:1789778259.959107:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:2.0:1789778259.959118:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:9718:x1876718295994368:12345-192.168.201.45@tcp:101:rm.0 00010000:00010000:2.0:1789778259.959138:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778259.959157:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157440f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b44 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959222:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959237:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959249:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959265:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959271:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959278:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959376:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157440f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959396:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157440f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959403:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157440f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778259.959459:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789778259.959464:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778259.959481:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157440f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959493:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157440f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959501:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959507:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959513:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959519:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.959523:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959531:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959543:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:2.0:1789778259.959546:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.959556:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959562:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157440f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959576:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959582:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959588:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959593:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.959596:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959601:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959608:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x25480f0f (ffff9b3e922c1c00) 00010000:00010000:2.0:1789778259.959611:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.959614:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959620:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157440f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959650:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157440f1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b44 expref: 18 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959675:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157440f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b44 expref: 17 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.959683:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778259.959685:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778259.959687:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8200, rc 0) 00000100:00100000:2.0:1789778259.959755:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:9718:x1876718295994368:12345-192.168.201.45@tcp:101:rm.0 Request processed in 639us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778259.959762:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:3.0:1789778259.963194:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778259.963292:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295994624 00000100:00100000:2.0:1789778259.963304:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295994624 00000100:00100000:2.0:1789778259.963366:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1789778259.963376:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:9718:x1876718295994624:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:2.0:1789778259.963457:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789778259.963487:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157440f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b44 expref: 17 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963509:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157440edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b28 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963518:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778259.963534:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157440ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b2f expref: 15 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963542:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:2.0:1789778259.963561:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778259.963582:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963593:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963603:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963616:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963622:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963628:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963737:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963745:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.963752:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789778259.964524:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789778259.964538:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314922472272ns, next at 315922469300ns, rc = 0 00010000:00010000:2.0:1789778259.964580:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964595:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964601:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964606:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964610:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964613:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964628:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778259.964647:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964652:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964657:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964663:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.964667:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.964671:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778259.964674:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.964677:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.964682:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8000 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778259.964686:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.964691:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:2.0:1789778259.964694:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789778259.964701:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.964710:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:3.0:1789778259.964712:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789778259.964715:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.964720:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157440f4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778259.964837:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778259.964844:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778259.964846:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778259.967544:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967563:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157440f48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967608:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967616:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967624:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967630:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.967635:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967643:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967660:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:2.0:1789778259.967663:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.967667:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.967674:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157440f3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778259.967705:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0bc6357 reply state 000000003b76f558 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778259.967714:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778259.968001:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:9718:x1876718295994624:12345-192.168.201.45@tcp:36:rm.0 Request processed in 4621us (4811us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789778259.968011:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00010000:00010000:2.0:1789778259.973206:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.973225:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.973234:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.973308:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778259.973314:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.973323:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.973342:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x25480f0f (ffff9b3e922c1900) 00010000:00010000:2.0:1789778259.973346:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778259.973351:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778259.973357:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157440f41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x25480f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778259.981058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778259.981563:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295994880 00000100:00100000:0.0:1789778259.981574:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295994880 00000100:00100000:0.0:1789778259.981690:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1789778259.981702:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:9718:x1876718295994880:12345-192.168.201.45@tcp:35:rm.0 00000100:00100000:0.0:1789778259.982161:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:9718:x1876718295994880:12345-192.168.201.45@tcp:35:rm.0 Request processed in 460us (1111us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789778259.982185:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1789778259.984504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778259.984698:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295995136 00000100:00100000:0.0:1789778259.984708:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295995136 00000100:00100000:0.0:1789778259.984768:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:0.0:1789778259.984778:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:9718:x1876718295995136:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:0.0:1789778259.984844:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789778259.984870:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757000/0x5a1e1c1157440f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b3d expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.984889:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157440eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b1a expref: 15 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.984898:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3e922c1100) 00010000:00010000:0.0:1789778259.984914:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157440e6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b0c expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.984921:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778259.984926:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789778259.984959:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.984971:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.984981:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.984994:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.985001:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.985008:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.985399:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.985417:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.985426:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778259.986938:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789778259.988234:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988249:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988256:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988262:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778259.988266:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988273:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988290:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778259.988293:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789778259.988297:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988321:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440f64 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988350:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988356:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988361:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988367:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778259.988370:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988376:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988383:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778259.988386:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778259.988388:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.988393:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440f56 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789778259.988404:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001293da7b reply state 0000000099496c91 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778259.988844:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789778259.989007:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:9718:x1876718295995136:12345-192.168.201.45@tcp:36:rm.0 Request processed in 4226us (4507us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789778259.989017:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00010000:00010000:0.0:1789778259.995926:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.995944:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.996026:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.996034:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778259.996039:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.996047:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.996193:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b3ea4c7a000) 00010000:00010000:0.0:1789778259.996197:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778259.996203:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778259.996210:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440f5d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778260.659112:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778261.682302:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778262.705272:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778263.739626:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778263.986441:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314901376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778263.986513:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778263.986570:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314901888:0@lo:400:kworker.0 00000100:00100000:0.0:1789778263.986595:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778263.986628:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778263.986635:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314901760:0@lo:400:kworker.0 00000100:00100000:0.0:1789778263.986659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778263.986691:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314901632:0@lo:400:kworker.0 00000100:00100000:0.0:1789778263.986715:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778263.986732:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314902144:0@lo:400:kworker.0 00000100:00100000:0.0:1789778263.986753:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778263.986771:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789778263.986776:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314901504:0@lo:400:kworker.0 00000100:00100000:0.0:1789778263.986803:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778263.986825:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314902016:0@lo:400:kworker.0 00000100:00100000:0.0:1789778263.986845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778263.986873:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314901376 00000100:00100000:0.0:1789778263.986881:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314901376 00000100:00100000:2.0:1789778263.986933:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314901888 00000100:00100000:2.0:1789778263.986938:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314901888 00000100:00100000:1.0:1789778263.988189:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314901504 00000100:00100000:1.0:1789778263.988201:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314901504 00000100:00100000:1.0:1789778263.988252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789778263.988261:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314901504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778263.988339:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314901504:12345-0@lo:400:kworker.0 Request processed in 78us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778263.988347:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789778263.988401:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314902144 00000100:00100000:1.0:1789778263.988406:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314902144 00000100:00100000:0.0:1789778263.989752:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789778263.989769:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314901376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778263.989933:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778263.989966:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789778263.989975:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314901888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778263.990001:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314901376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 239us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778263.990007:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789778263.990031:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314901760 00000100:00100000:0.0:1789778263.990036:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314901760 00000100:00100000:0.0:1789778263.990080:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314901632 00000100:00100000:0.0:1789778263.990084:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314901632 00000100:00100000:0.0:1789778263.990098:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314902016 00000100:00100000:0.0:1789778263.990100:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314902016 00000100:00100000:2.0:1789778263.990227:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314901888:12345-0@lo:400:kworker.0 Request processed in 184us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778263.990236:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789778263.990288:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789778263.990297:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314902144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778263.990334:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314902144:12345-0@lo:400:kworker.0 Request processed in 40us (3580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778263.990340:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789778263.990368:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789778263.990376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789778263.990376:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314901760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778263.990381:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314901632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778263.990413:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314901632:12345-0@lo:400:kworker.0 Request processed in 31us (3697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778263.990413:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314901760:12345-0@lo:400:kworker.0 Request processed in 39us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778263.990419:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1789778263.993210:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789778263.993222:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789778263.993225:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778263.993280:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314901504:0@lo:400:kworker.0 00000100:00100000:2.0:1789778263.993303:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314901632:0@lo:400:kworker.0 00010000:00080000:2.0:1789778263.993318:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec16d0700 x1876718314902144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778263.993328:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314902144:0@lo:400:kworker.0 00000100:00100000:2.0:1789778263.993381:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314901760:0@lo:400:kworker.0 00010000:00080000:2.0:1789778263.993396:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec16d2d80 x1876718314901888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778263.993403:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314901888:0@lo:400:kworker.0 00010000:00080000:2.0:1789778263.993412:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df0000 x1876718314901376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778263.993445:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314901376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778263.998547:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789778263.998557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789778263.998576:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314902016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778263.998907:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314902016:12345-0@lo:400:kworker.0 Request processed in 338us (12059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778263.998914:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789778263.999925:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314902016:0@lo:400:kworker.0 00000001:02000400:2.0:1789778264.019518:0:11615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1789778264.500689:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314902272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778264.500764:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789778264.500918:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319458851830ns, next at 320458849560ns, rc = 0 00000100:00100000:0.0:1789778264.500947:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314902272 00000100:00100000:0.0:1789778264.500955:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314902272 00000100:00100000:0.0:1789778264.501015:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789778264.501024:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314902272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778264.501056:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778264.501302:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314902272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778264.501310:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789778264.501383:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3d822f0700 x1876718314902272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778264.501400:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314902272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778264.753286:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778264.850427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778264.852374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778264.856905:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295995264 00000100:00100000:2.0:1789778264.856921:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295995264 00000100:00100000:2.0:1789778264.856998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 250 00000100:00100000:2.0:1789778264.857009:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295995264:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778264.857105:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295995264:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 97us (6687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778264.857113:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 250 00000100:00100000:0.0:1789778264.857492:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295995392 00000100:00100000:0.0:1789778264.857497:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295995392 00000100:00100000:0.0:1789778264.857544:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:0.0:1789778264.857552:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2375:x1876718295995392:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778264.857591:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2375:x1876718295995392:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 41us (5225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778264.857598:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00080000:2.0:1789778264.857720:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778264.863780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778264.863825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778264.863859:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295995520 00000100:00100000:2.0:1789778264.863869:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295995520 00000100:00100000:2.0:1789778264.863934:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:2.0:1789778264.863944:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295995520:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778264.864091:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295995520:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 147us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778264.864100:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00080000:2.0:1789778264.864124:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778264.864601:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295995648 00000100:00100000:1.0:1789778264.864607:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295995648 00000100:00100000:1.0:1789778264.864694:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:1.0:1789778264.864704:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718295995648:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778264.864759:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718295995648:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 58us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778264.864766:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00080000:2.0:1789778264.864833:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1789778264.988366:0:11663:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc142ac890 20000000:00000080:3.0:1789778264.988385:0:11663:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3ec16fd000 uarg=0000000000000000 20000000:01000000:3.0:1789778264.988421:0:11663:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789778264.988427:0:11663:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789778264.988432:0:11663:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789778264.989474:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789778264.989617:0:11663:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789778264.997322:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789778264.997399:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789778264.997461:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789778264.997481:0:11663:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789778264.997501:0:11663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997521:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997529:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997552:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997560:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997568:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997575:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997618:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997635:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 18 pid: 5840 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778264.997664:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902400:0@lo:104: 00000100:00100000:3.0:1789778264.997805:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778264.997940:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.997949:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 18 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778264.997958:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902528:0@lo:104: 00000100:00100000:3.0:1789778264.997979:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778264.998061:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.998097:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 18 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778264.998106:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e987e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902656:0@lo:104: 00000100:00100000:3.0:1789778264.998131:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778264.998376:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.998387:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 12 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778264.998396:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902784:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778264.998453:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778264.998461:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 12 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778264.998467:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902912:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778264.998489:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86182d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778264.999699:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789778264.999718:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314902400 00000100:00100000:1.0:1789778264.999726:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314902400 00000100:00100000:1.0:1789778265.000226:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314902528 00000100:00100000:1.0:1789778265.000230:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314902528 00000100:00100000:1.0:1789778265.000241:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314902656 00000100:00100000:1.0:1789778265.000244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314902656 00000100:00100000:1.0:1789778265.000259:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778265.000269:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:11663:x1876718314902400:12345-0@lo:104: 00010000:00010000:1.0:1789778265.000285:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778265.000431:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789778265.000438:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+5:11663:x1876718314902400:12345-0@lo:104: Request processed in 170us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778265.000446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778265.000466:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789778265.000472:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:11663:x1876718314902528:12345-0@lo:104: 00010000:00010000:1.0:1789778265.000480:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778265.000535:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789778265.000540:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+4:11663:x1876718314902528:12345-0@lo:104: Request processed in 69us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778265.000546:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789778265.000559:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789778265.000565:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0127050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:11663:x1876718314902656:12345-0@lo:104: 00010000:00010000:1.0:1789778265.000572:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778265.000599:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789778265.000603:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0127050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+3:11663:x1876718314902656:12345-0@lo:104: Request processed in 39us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778265.000608:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789778265.000710:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789778265.000716:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000723:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150ea00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778265.000742:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000751:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778265.000758:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778265.000763:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789778265.000798:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000805:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778265.000825:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000832:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150ea00/0x5a1e1c1157440e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000855:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778265.000858:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000863:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778265.000866:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000872:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778265.000888:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778265.000893:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789778265.000907:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000912:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778265.000928:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000934:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157440e29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000942:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778265.000945:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000950:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756e00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778265.000953:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.000960:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778265.000966:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778265.000971:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789778265.001003:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001009:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778265.001016:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001022:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756e00/0x5a1e1c1157440e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157440e22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001035:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778265.001036:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778265.001038:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778265.001052:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314903040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778265.001110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778265.001166:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314903168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778265.001190:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778265.001209:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778265.001214:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314903296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778265.001235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778265.001263:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903040 00000100:00100000:2.0:1789778265.001267:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903040 00010000:00010000:2.0:1789778265.001289:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 19 pid: 5840 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778265.001303:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903168 00000100:00100000:2.0:1789778265.001306:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903168 00010000:00010000:2.0:1789778265.001316:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 20 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778265.001351:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903296 00000100:00100000:2.0:1789778265.001354:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903296 00010000:00010000:2.0:1789778265.001366:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 21 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778265.001379:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789778265.001385:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+21:3313:x1876718314903040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778265.001398:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778265.001403:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 21 pid: 5840 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001419:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 21 pid: 5840 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001436:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778265.001464:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+21:3313:x1876718314903040:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778265.001470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789778265.001483:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789778265.001488:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+20:3310:x1876718314903168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778265.001495:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778265.001499:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 20 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001507:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 20 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001516:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778265.001542:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+20:3310:x1876718314903168:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778265.001548:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789778265.001559:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789778265.001565:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314903296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778265.001571:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778265.001575:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 19 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001584:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 19 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778265.001593:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778265.001610:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314903296:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778265.001616:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789778265.001667:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314903296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778265.001675:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314903168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778265.001695:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314903040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778265.007236:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1789778265.007404:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440e3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440e37 expref: 18 pid: 5840 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778265.007428:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902400:0@lo:104: 00010000:00010000:3.0:1789778265.007613:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157440e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440e29 expref: 17 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778265.007649:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902528:0@lo:104: 00010000:00010000:3.0:1789778265.007665:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95757200/0x5a1e1c1157440e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157440e1b expref: 16 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778265.007672:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e987e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902656:0@lo:104: 00000100:00100000:0.0:1789778265.008053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778265.008120:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778265.008354:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902784:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778265.008366:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1876718314902912:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778265.008400:0:11663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778265.008475:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778265.009163:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295995904 00000100:00100000:3.0:1789778265.009172:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295995904 00010000:00010000:3.0:1789778265.009209:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 13 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778265.009242:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295995776 00000100:00100000:3.0:1789778265.009246:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295995776 00010000:00010000:3.0:1789778265.009259:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 14 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778265.009273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1789778265.009281:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+14:2374:x1876718295995904:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778265.009294:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778265.009300:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 14 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009309:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 14 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009336:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81656800/0x5a1e1c1157440e0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7af7 expref: 14 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009363:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778265.009427:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2374:x1876718295995904:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 144us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778265.009434:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1789778265.009451:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:3.0:1789778265.009459:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:2374:x1876718295995776:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778265.009467:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778265.009471:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 12 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009480:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 12 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009490:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150f800/0x5a1e1c1157440e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7afe expref: 12 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009501:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009509:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009523:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009541:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009548:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009555:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009562:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778265.009566:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009575:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009589:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009599:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778265.009618:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+11:2374:x1876718295995776:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 161us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778265.009625:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00010000:00010000:3.0:1789778265.009662:0:11663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009669:0:11663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.009675:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f6b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789778265.066669:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789778265.066696:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789778265.066715:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789778265.067265:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778265.067286:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314903424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789778265.067364:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778265.067411:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903424 00000100:00100000:3.0:1789778265.067418:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903424 00000100:00100000:3.0:1789778265.067490:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789778265.067499:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314903424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789778265.067527:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789778265.067561:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aadd954, atime: 0x6aadd954, ctime: 0x6aadd954, blocks: 0x1 00010000:00010000:3.0:1789778265.067569:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.067586:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789778265.067591:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778265.067597:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.067614:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.067624:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.067632:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.067671:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1789778265.067704:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778265.068263:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314903424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 763us (897us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789778265.068274:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789778265.068303:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778265.068310:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.068320:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778265.068325:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.068334:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.068364:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.068371:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec01bd0/0x5a1e1c1157440f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778265.068388:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778265.068390:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778265.068391:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789778265.068398:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec0d78700/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789778265.068405:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314903424:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789778265.777378:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778266.801555:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778266.954847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778266.954987:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996032 00000100:00100000:3.0:1789778266.955012:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996032 00000100:00100000:3.0:1789778266.955101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 251 00000100:00100000:3.0:1789778266.955112:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+11:5629:x1876718295996032:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778266.955141:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778266.955161:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b4b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778266.955327:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b4b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778266.955340:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b4b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778266.955350:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f400, rc 0) 00000100:00100000:3.0:1789778266.955413:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295996032:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 304us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778266.955421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 251 00000100:00100000:1.0:1789778266.962260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778266.962420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996160 00000100:00100000:2.0:1789778266.962431:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996160 00000100:00100000:2.0:1789778266.962504:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 252 00000100:00100000:2.0:1789778266.962516:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295996160:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778266.962825:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295996160:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 310us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778266.962833:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 252 00000100:00100000:0.0:1789778266.970942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778266.971096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996288 00000100:00100000:3.0:1789778266.971106:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996288 00000100:00100000:3.0:1789778266.971167:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 253 00000100:00100000:3.0:1789778266.971399:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295996288:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778266.971895:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295996288:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 718us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778266.971904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 253 00000100:00100000:1.0:1789778266.984222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778266.984360:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996416 00000100:00100000:3.0:1789778266.984372:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996416 00000100:00100000:3.0:1789778266.984439:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 254 00000100:00100000:3.0:1789778266.984450:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:9988:x1876718295996416:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789778266.984785:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:9988:x1876718295996416:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 335us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778266.984794:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 254 00000100:00100000:1.0:1789778266.990246:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778266.990638:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996544 00000100:00100000:2.0:1789778266.990650:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996544 00000100:00100000:2.0:1789778266.990705:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 255 00000100:00100000:2.0:1789778266.990717:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+12:9988:x1876718295996544:12345-192.168.201.45@tcp:502:llog_process_th.0 10000000:01000000:3.0:1789778266.993194:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789778266.993206:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ebf7c9000 from 7 10000000:01000000:3.0:1789778266.993211:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:2.0:1789778266.993442:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+12:9988:x1876718295996544:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 2721us (3199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778266.993455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 255 00010000:00010000:3.0:1789778266.993633:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778266.993646:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778266.993658:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778266.993681:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314903552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789778266.993739:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778266.993803:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778266.997908:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903552 00000100:00100000:2.0:1789778266.997926:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903552 00000100:00100000:2.0:1789778266.997994:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789778266.998004:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:5843:x1876718314903552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778266.998020:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778266.998039:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e833f9c00/0x5a1e1c1157440f87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440f80 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778266.998101:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e833f9c00/0x5a1e1c1157440f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440f80 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778266.998112:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e833f9c00/0x5a1e1c1157440f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440f80 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778266.998121:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9c00, rc 0) 00000100:00100000:2.0:1789778266.998202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314903552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (4462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778266.998209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789778267.002414:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314903552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778267.002455:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.002469:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778267.002549:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314903680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.002604:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.002668:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778267.006482:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903680 00000100:00100000:2.0:1789778267.006499:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903680 00000100:00100000:2.0:1789778267.006579:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789778267.006606:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314903680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778267.006953:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314903680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778267.006961:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789778267.008755:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314903680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.008818:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314903808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.008892:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.009195:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778267.020272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778267.035399:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903808 00000100:00100000:2.0:1789778267.035417:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903808 00000100:00100000:2.0:1789778267.035550:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996672 00000100:00100000:2.0:1789778267.035554:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996672 00000100:00100000:2.0:1789778267.035590:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789778267.035601:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314903808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778267.036557:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 259 00000100:00100000:0.0:1789778267.036571:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+12:5629:x1876718295996672:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778267.036580:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778267.036596:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756800/0x5a1e1c1157440f8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b52 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778267.036623:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756800/0x5a1e1c1157440f8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b52 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778267.036634:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756800/0x5a1e1c1157440f8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b52 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778267.036643:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756800, rc 0) 00000100:00100000:0.0:1789778267.036715:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295996672:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 148us (16455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778267.036723:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 259 00000100:00100000:2.0:1789778267.038167:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314903808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2563us (29270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778267.038178:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789778267.038207:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314903808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.040371:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11678:1876718314903936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778267.040482:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.040529:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778267.040683:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314903936 00000100:00100000:0.0:1789778267.040692:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314903936 00000100:00100000:0.0:1789778267.040741:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789778267.040750:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:11678:x1876718314903936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778267.040973:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:11678:x1876718314903936:12345-0@lo:502:llog_process_th.0 Request processed in 224us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778267.040982:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789778267.041501:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11678:1876718314903936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789778267.041537:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778267.041552:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778267.041555:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789778267.041562:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3ebf7c9000 00000020:00000080:1.0:1789778267.041564:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789778267.041653:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11678:1876718314904064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778267.041693:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778267.041774:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e876dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789778267.053232:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904064 00000100:00100000:0.0:1789778267.053250:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904064 00000100:00100000:0.0:1789778267.053562:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789778267.053574:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:11678:x1876718314904064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778267.053851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:11678:x1876718314904064:12345-0@lo:502:llog_process_th.0 Request processed in 280us (12157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778267.053860:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789778267.053991:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11678:1876718314904064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789778267.054023:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778267.054030:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778267.054032:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789778267.054036:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789778267.054407:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789778267.054427:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789778267.054436:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778267.054447:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778267.054457:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789778267.054460:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ec0d89800 from 7 10000000:01000000:0.0:1789778267.054463:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778267.054500:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778267.054508:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778267.054559:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778267.054583:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789778267.054625:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778267.054707:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.055116:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904192 00000100:00100000:3.0:1789778267.055123:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904192 00000100:00100000:3.0:1789778267.055161:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789778267.055170:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:5843:x1876718314904192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778267.055182:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778267.055195:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440f9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440f95 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.055217:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440f9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440f95 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.055227:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440f9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440f95 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.055236:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150e200, rc 0) 00000100:00100000:3.0:1789778267.055273:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314904192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.055292:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789778267.055354:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778267.055379:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.055387:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778267.055437:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.055461:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.055475:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.055486:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904320 00000100:00100000:3.0:1789778267.055489:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904320 00000100:00100000:3.0:1789778267.055509:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789778267.055529:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314904320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.055744:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314904320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.055750:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789778267.055777:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.055803:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.055836:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.055849:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e84fdc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.055859:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904448 00000100:00100000:3.0:1789778267.055862:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904448 00000100:00100000:3.0:1789778267.055880:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789778267.055885:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314904448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.056010:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95777850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314904448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.056025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789778267.056060:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.056249:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11680:1876718314904576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778267.056280:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.056298:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904576 00000100:00100000:3.0:1789778267.056301:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904576 00000100:00100000:3.0:1789778267.056335:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789778267.056341:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:11680:x1876718314904576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778267.056469:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:11680:x1876718314904576:12345-0@lo:502:llog_process_th.0 Request processed in 128us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.056476:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789778267.056505:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e84fdcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.056518:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11680:1876718314904576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778267.056539:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778267.056547:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778267.056549:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789778267.056556:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3ec0d89800 00000020:00000080:3.0:1789778267.056558:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789778267.057007:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11680:1876718314904704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778267.057042:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.057062:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904704 00000100:00100000:3.0:1789778267.057086:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904704 00000100:00100000:3.0:1789778267.057111:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789778267.057117:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:11680:x1876718314904704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778267.057237:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:11680:x1876718314904704:12345-0@lo:502:llog_process_th.0 Request processed in 120us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.057250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789778267.057281:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e84fdcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.057293:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11680:1876718314904704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778267.057327:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778267.057332:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778267.057333:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789778267.057338:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789778267.057389:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789778267.057404:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778267.057413:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.057422:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778267.057431:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789778267.057434:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3eabbad800 from 7 10000000:01000000:3.0:1789778267.057436:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789778267.057457:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.057464:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.057473:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778267.057485:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.057510:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.057528:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e84fdcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.057539:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904832 00000100:00100000:3.0:1789778267.057543:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904832 00000100:00100000:3.0:1789778267.057562:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789778267.057568:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:5843:x1876718314904832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778267.057576:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778267.057587:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440faa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157440fa3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.057605:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440faa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157440fa3 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.057614:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440faa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157440fa3 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.057621:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150ea00, rc 0) 00000100:00100000:3.0:1789778267.057648:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95775450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314904832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.057654:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789778267.057681:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778267.057692:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778267.057700:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778267.057735:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.057758:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.057778:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e84fdcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.057789:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314904960 00000100:00100000:3.0:1789778267.057792:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314904960 00000100:00100000:3.0:1789778267.057811:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789778267.057817:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314904960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.057993:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314904960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.058000:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789778267.058027:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314904960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.058051:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314905088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.058104:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778267.058116:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e84fdcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789778267.058126:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905088 00000100:00100000:3.0:1789778267.058128:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905088 00000100:00100000:3.0:1789778267.058148:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789778267.058154:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314905088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.058258:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95774850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:5843:x1876718314905088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.058264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789778267.058298:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:5843:1876718314905088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778267.060986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778267.065470:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996800 00000100:00100000:2.0:1789778267.065487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996800 00000100:00100000:2.0:1789778267.065561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 270 00000100:00100000:2.0:1789778267.065573:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295996800:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778267.065874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295996800:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 302us (4896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778267.065884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 270 00000100:00100000:3.0:1789778267.072882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778267.072998:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295996928 00000100:00100000:3.0:1789778267.073006:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295996928 00000100:00100000:3.0:1789778267.073048:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 271 00000100:00100000:3.0:1789778267.073056:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295996928:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778267.073635:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95776850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:5629:x1876718295996928:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 577us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.073643:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 271 00000100:00100000:0.0:1789778267.074686:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11682:1876718314905216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778267.074755:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778267.074803:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778267.074854:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905216 00000100:00100000:2.0:1789778267.074862:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905216 00000100:00100000:2.0:1789778267.074904:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789778267.074913:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:11682:x1876718314905216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778267.075196:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:11682:x1876718314905216:12345-0@lo:502:llog_process_th.0 Request processed in 283us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778267.075213:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789778267.075360:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11682:1876718314905216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789778267.075390:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778267.075399:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778267.075401:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789778267.075407:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3eabbad800 00000020:00000080:0.0:1789778267.075410:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789778267.075492:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11682:1876718314905344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778267.075525:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778267.075554:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778267.075586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905344 00000100:00100000:2.0:1789778267.075591:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905344 00000100:00100000:2.0:1789778267.075625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789778267.075632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:11682:x1876718314905344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778267.075754:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:11682:x1876718314905344:12345-0@lo:502:llog_process_th.0 Request processed in 122us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778267.075762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789778267.075963:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:11682:1876718314905344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789778267.075985:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778267.075989:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778267.075991:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789778267.075994:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789778267.076199:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789778267.076217:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789778267.076227:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778267.076237:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789778267.090900:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789778267.094656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778267.095583:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997056 00000100:00100000:3.0:1789778267.095596:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997056 00000100:00100000:3.0:1789778267.095656:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 274 00000100:00100000:3.0:1789778267.095666:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:9991:x1876718295997056:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789778267.095922:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:9991:x1876718295997056:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 256us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778267.095931:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 274 00000100:00100000:1.0:1789778267.100825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778267.101120:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997184 00000100:00100000:2.0:1789778267.101130:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997184 00000100:00100000:2.0:1789778267.101187:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 275 00000100:00100000:2.0:1789778267.101196:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:9991:x1876718295997184:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789778267.101460:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:9991:x1876718295997184:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 263us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778267.101469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 275 00010000:00010000:0.0:1789778267.826549:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778268.148188:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789778268.849704:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778269.105907:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314905472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778269.105982:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778269.106389:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905472 00000100:00100000:3.0:1789778269.106398:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905472 00000100:00100000:3.0:1789778269.106471:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789778269.106483:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314905472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778269.106519:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778269.106580:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314905472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778269.106587:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789778269.106792:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314905728:0@lo:400:kworker.0 00000100:00100000:2.0:1789778269.106827:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778269.106853:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789778269.106877:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314905600:0@lo:400:kworker.0 00000100:00100000:2.0:1789778269.106908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778269.106932:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314906112:0@lo:400:kworker.0 00000100:00100000:2.0:1789778269.106958:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778269.106988:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905728 00000100:00100000:2.0:1789778269.106992:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905728 00000100:00100000:2.0:1789778269.107023:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789778269.107030:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314905728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778269.107095:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314905728:12345-0@lo:400:kworker.0 Request processed in 65us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778269.107102:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789778269.107122:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314906112 00000100:00100000:2.0:1789778269.107125:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314906112 00000100:00100000:2.0:1789778269.107221:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789778269.107229:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314906112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778269.107417:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314906112:12345-0@lo:400:kworker.0 Request processed in 188us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778269.107424:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789778269.107469:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314906112:0@lo:400:kworker.0 00000100:00100000:2.0:1789778269.107481:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314905728:0@lo:400:kworker.0 00000100:00080000:1.0:1789778269.107562:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789778269.107575:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778269.107588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905600 00000100:00100000:1.0:1789778269.107592:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905600 00000100:00100000:1.0:1789778269.107629:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789778269.107637:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314905600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.107677:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314905600:12345-0@lo:400:kworker.0 Request processed in 42us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778269.107684:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789778269.107713:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314905984:0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.107738:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789778269.107766:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec0d7a300 x1876718314905472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778269.107793:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314905472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778269.107807:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789778269.107813:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314905856:0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.107838:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778269.107865:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905984 00000100:00100000:1.0:1789778269.107868:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905984 00000100:00100000:1.0:1789778269.107895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314905856 00000100:00100000:1.0:1789778269.107899:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314905856 00000100:00100000:1.0:1789778269.107918:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789778269.107925:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314905984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.107958:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314905984:12345-0@lo:400:kworker.0 Request processed in 34us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778269.107964:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789778269.107977:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789778269.107984:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314905856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.108011:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314905856:12345-0@lo:400:kworker.0 Request processed in 27us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778269.108017:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1789778269.108034:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778269.108050:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314905600:0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.108108:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314905856:0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.108118:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314905984:0@lo:400:kworker.0 00000100:00100000:1.0:1789778269.617593:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314906240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778269.617681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778269.617998:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314906240 00000100:00100000:2.0:1789778269.618006:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314906240 00000100:00100000:2.0:1789778269.618060:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789778269.618154:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314906240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778269.618189:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778269.618321:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314906240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778269.618336:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789778269.618382:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314906240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778269.873305:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778269.962685:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778269.962735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778269.962771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778269.962807:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997440 00000100:00100000:1.0:1789778269.962819:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997440 00000100:00100000:1.0:1789778269.962901:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:1.0:1789778269.962913:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295997440:12345-192.168.201.45@tcp:400:kworker.0 00000100:00080000:3.0:1789778269.962928:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778269.963001:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718295997440:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778269.963008:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:0.0:1789778269.963091:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997568 00000100:00100000:0.0:1789778269.963096:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997568 00000100:00100000:0.0:1789778269.963141:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1789778269.963149:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295997568:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778269.963203:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295997568:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 54us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778269.963210:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00080000:1.0:1789778269.963276:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778269.963918:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997312 00000100:00100000:2.0:1789778269.963924:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997312 00000100:00100000:2.0:1789778269.963978:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 277 00000100:00100000:2.0:1789778269.963987:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295997312:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778269.964041:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295997312:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 55us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778269.964048:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 277 00000100:00100000:3.0:1789778269.976681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778269.976787:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997696 00000100:00100000:2.0:1789778269.976798:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997696 00000100:00100000:2.0:1789778269.976889:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:2.0:1789778269.976909:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718295997696:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778269.977007:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718295997696:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778269.977015:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00080000:1.0:1789778269.977234:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789778270.273758:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1789778270.898728:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778271.921681:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778272.945409:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778273.969949:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778274.225701:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314906752:0@lo:400:kworker.0 00000100:00100000:2.0:1789778274.225778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778274.225842:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778274.225849:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314906624:0@lo:400:kworker.0 00000100:00100000:2.0:1789778274.225873:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778274.225902:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314906752 00000100:00100000:2.0:1789778274.225922:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314906752 00000100:00100000:2.0:1789778274.225975:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789778274.225998:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314906752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778274.226059:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314906752:12345-0@lo:400:kworker.0 Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778274.226086:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789778274.226461:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314906368:0@lo:400:kworker.0 00000100:00100000:0.0:1789778274.226507:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778274.226534:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314906880:0@lo:400:kworker.0 00000100:00100000:0.0:1789778274.226555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778274.226573:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789778274.226578:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314906496:0@lo:400:kworker.0 00000100:00100000:0.0:1789778274.226598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778274.226613:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314907008:0@lo:400:kworker.0 00000100:00100000:0.0:1789778274.226633:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778274.226657:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314906368 00000100:00100000:0.0:1789778274.226661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314906368 00000100:00100000:0.0:1789778274.226689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789778274.226695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314906368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778274.226730:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314906368:12345-0@lo:400:kworker.0 Request processed in 35us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778274.226736:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789778274.226777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314906624 00000100:00100000:0.0:1789778274.226781:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314906624 00000100:00100000:0.0:1789778274.226807:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314906880 00000100:00100000:0.0:1789778274.226810:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314906880 00000100:00080000:1.0:1789778274.227224:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789778274.227229:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778274.227265:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907008 00000100:00100000:1.0:1789778274.227269:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907008 00000100:00100000:1.0:1789778274.227302:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789778274.227419:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314907136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778274.227453:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314907008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778274.227461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778274.227502:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314906496 00000100:00100000:1.0:1789778274.227506:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314907008:12345-0@lo:400:kworker.0 Request processed in 195us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778274.227508:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314906496 00000100:00100000:1.0:1789778274.227517:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789778274.227537:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789778274.227546:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314906624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778274.227549:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789778274.227561:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314906496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778274.227593:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314906624:12345-0@lo:400:kworker.0 Request processed in 48us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778274.227601:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789778274.227617:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314906496:12345-0@lo:400:kworker.0 Request processed in 57us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778274.227624:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789778274.227644:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907136 00000100:00080000:1.0:1789778274.227645:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778274.227650:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907136 00000100:00100000:3.0:1789778274.227683:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789778274.227691:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314907136:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778274.227697:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314906496:0@lo:400:kworker.0 00000100:00100000:1.0:1789778274.227710:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00002000:00000024:3.0:1789778274.227721:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000004:00080000:1.0:1789778274.227727:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec0d78700, transno 4294967300 00000100:00100000:1.0:1789778274.227742:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314907008:0@lo:400:kworker.0 00000100:00100000:1.0:1789778274.227757:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314906368:0@lo:400:kworker.0 00000100:00100000:3.0:1789778274.227766:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314907136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778274.227774:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789778274.227927:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3eb5df0000 x1876718314907136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778274.227944:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314907136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778274.228939:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789778274.228961:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314906880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778274.229041:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314906880:12345-0@lo:400:kworker.0 Request processed in 84us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778274.229047:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789778274.229104:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314906880:0@lo:400:kworker.0 00000100:00100000:2.0:1789778274.229769:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314906624:0@lo:400:kworker.0 00010000:00080000:2.0:1789778274.229786:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec16d3800 x1876718314906752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778274.229795:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314906752:0@lo:400:kworker.0 00000100:00100000:0.0:1789778274.739806:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778274.739835:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314907264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778274.739911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778274.739999:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907264 00000100:00100000:0.0:1789778274.740009:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907264 00000100:00100000:0.0:1789778274.740056:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789778274.740100:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314907264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778274.740145:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778274.740220:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314907264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778274.740227:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789778274.740299:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314907264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789778274.995349:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778275.085226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778275.085335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778275.085381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778275.085491:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998080 00000100:00100000:2.0:1789778275.085501:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998080 00000100:00100000:2.0:1789778275.085574:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:2.0:1789778275.087526:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295998080:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778275.087984:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295998080:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 2397us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778275.087996:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00080000:2.0:1789778275.088192:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778275.088334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778275.090526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997824 00000100:00100000:1.0:1789778275.090543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997824 00000100:00100000:1.0:1789778275.091298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 279 00000100:00100000:1.0:1789778275.091313:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295997824:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778275.091443:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718295997824:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 135us (6226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778275.091450:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 279 00000100:00100000:3.0:1789778275.093875:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295997952 00000100:00100000:3.0:1789778275.093890:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295997952 00000100:00100000:3.0:1789778275.093963:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998208 00000100:00100000:3.0:1789778275.093966:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998208 00000100:00100000:3.0:1789778275.093994:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:3.0:1789778275.094004:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295997952:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778275.094115:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718295997952:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 112us (8732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778275.094124:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:3.0:1789778275.094140:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:3.0:1789778275.094146:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295998208:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778275.094186:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718295998208:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 40us (5853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778275.094192:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00080000:2.0:1789778275.095148:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789778276.017284:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778277.041429:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778278.066906:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789778278.385880:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789778279.091730:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778279.345474:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789778279.345509:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314907520:0@lo:400:kworker.0 00000100:00100000:1.0:1789778279.345567:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314907776:0@lo:400:kworker.0 00000100:00100000:2.0:1789778279.345587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778279.345647:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789778279.345732:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314907648:0@lo:400:kworker.0 00000100:00100000:1.0:1789778279.349134:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778279.349240:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907520 00000100:00100000:1.0:1789778279.349250:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907520 00000100:00100000:1.0:1789778279.349299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789778279.349310:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314907520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778279.349364:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314907520:12345-0@lo:400:kworker.0 Request processed in 56us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778279.349372:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789778279.349407:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907776 00000100:00100000:1.0:1789778279.349411:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907776 00000100:00100000:1.0:1789778279.349630:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789778279.349639:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314907776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778279.349696:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314907776:12345-0@lo:400:kworker.0 Request processed in 59us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778279.349703:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789778279.349751:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314907776:0@lo:400:kworker.0 00000100:00080000:1.0:1789778279.349795:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778279.358077:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314907520:0@lo:400:kworker.0 00000100:00100000:2.0:1789778279.359739:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314907392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778279.360627:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778279.360683:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778279.360695:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314908032:0@lo:400:kworker.0 00000100:00100000:0.0:1789778279.360750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778279.360804:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908032 00000100:00100000:0.0:1789778279.360813:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908032 00000100:00100000:0.0:1789778279.360877:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789778279.360886:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314908032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778279.360944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314908032:12345-0@lo:400:kworker.0 Request processed in 59us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778279.360951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1789778279.360986:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778279.361016:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314908032:0@lo:400:kworker.0 00000100:00100000:1.0:1789778279.362120:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907904 00000100:00100000:1.0:1789778279.362131:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907904 00000100:00100000:1.0:1789778279.362192:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789778279.362200:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314907904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778279.362201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778279.362250:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314907904:12345-0@lo:400:kworker.0 Request processed in 52us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778279.362257:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789778279.362274:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907392 00000100:00100000:1.0:1789778279.362277:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907392 00000100:00100000:1.0:1789778279.362314:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789778279.362321:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314907392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789778279.362350:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778279.362388:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314907392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778279.362394:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789778279.362737:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98614e00 x1876718314907392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778279.362773:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314907392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789778279.363438:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789778279.363495:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e88de7480 x1876718314907904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778279.363507:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789778279.363685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778279.363769:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314908160:0@lo:400:kworker.0 00000100:00100000:3.0:1789778279.363803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778279.363886:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908160 00000100:00100000:2.0:1789778279.363892:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908160 00000100:00100000:2.0:1789778279.363950:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789778279.363961:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314908160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778279.364018:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314908160:12345-0@lo:400:kworker.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778279.364025:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789778279.364284:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314908160:0@lo:400:kworker.0 00000100:00080000:0.0:1789778279.364345:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778279.368034:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314907648 00000100:00100000:1.0:1789778279.368058:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314907648 00000100:00100000:1.0:1789778279.368163:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789778279.368176:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314907648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778279.368292:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314907648:12345-0@lo:400:kworker.0 Request processed in 119us (4607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778279.368318:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789778279.368521:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314907648:0@lo:400:kworker.0 00000100:00100000:3.0:1789778279.857476:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778279.857511:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314908288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778279.857588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778279.857789:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908288 00000100:00100000:0.0:1789778279.857797:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908288 00000100:00100000:0.0:1789778279.857853:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789778279.857863:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314908288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778279.857899:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778279.857945:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314908288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778279.857953:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789778279.858565:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314908288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778280.116194:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778280.204031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778280.204108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778280.204423:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998336 00000100:00100000:2.0:1789778280.204435:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998336 00000100:00100000:2.0:1789778280.204505:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 281 00000100:00100000:2.0:1789778280.204515:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295998336:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778280.204603:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295998336:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 89us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778280.204611:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 281 00000100:00100000:0.0:1789778280.205901:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998464 00000100:00100000:0.0:1789778280.205934:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998464 00000100:00100000:0.0:1789778280.206047:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:0.0:1789778280.206057:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295998464:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778280.206172:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295998464:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 117us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778280.206179:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00080000:1.0:1789778280.211251:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778280.221713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778280.221756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778280.221844:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998592 00000100:00100000:2.0:1789778280.221855:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998592 00000100:00100000:2.0:1789778280.221936:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1789778280.221946:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2371:x1876718295998592:12345-192.168.201.45@tcp:9:kworker.0 00000020:00000080:2.0:1789778280.221975:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440ee6 00000100:00080000:2.0:1789778280.221983:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9b3ebfe32800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789778280.222016:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789778280.222680:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+2:2371:x1876718295998592:12345-192.168.201.45@tcp:9:kworker.0 Request processed in 732us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778280.222689:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00010000:00010000:3.0:1789778280.222952:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789778280.222969:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778280.223001:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998720 00000100:00100000:1.0:1789778280.223006:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998720 00000100:00100000:1.0:1789778280.223102:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:1.0:1789778280.223112:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718295998720:12345-192.168.201.45@tcp:400:kworker.0 00000100:00080000:0.0:1789778280.223240:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778280.223420:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718295998720:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 309us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778280.223428:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00000001:00100000:0.0:1789778280.449679:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:0.0:1789778280.449688:0:7641:0:(genops.c:885:class_export_put()) final put ffff9b3ebfe31000/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:1.0:1789778280.453029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebfe31000/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a for lustre-OST0001 00000020:00000080:1.0:1789778280.453154:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ebfe32800 for lustre-OST0001 00010000:00010000:0.0:1789778281.138560:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778282.162087:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778283.185589:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778284.209400:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778284.465418:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314908800:0@lo:400:kworker.0 00000100:00100000:2.0:1789778284.465441:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314908672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778284.465513:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314908416:0@lo:400:kworker.0 00000100:00100000:1.0:1789778284.465567:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314908544:0@lo:400:kworker.0 00000100:00100000:2.0:1789778284.468542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778284.468621:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778284.468633:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314909184:0@lo:400:kworker.0 00000100:00100000:2.0:1789778284.468667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778284.468708:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909184 00000100:00100000:2.0:1789778284.468715:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909184 00000100:00100000:2.0:1789778284.468772:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789778284.468781:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314909184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778284.468790:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778284.468832:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314909184:12345-0@lo:400:kworker.0 Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778284.468853:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789778284.468854:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908800 00000100:00100000:3.0:1789778284.468857:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908800 00000100:00080000:2.0:1789778284.468874:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789778284.468879:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778284.468886:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789778284.468892:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314908800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778284.468904:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314909184:0@lo:400:kworker.0 00000100:00100000:3.0:1789778284.468927:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314908800:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778284.468933:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789778284.468963:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314908800:0@lo:400:kworker.0 00000100:00100000:3.0:1789778284.469007:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908672 00000100:00100000:3.0:1789778284.469011:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908672 00000100:00100000:3.0:1789778284.469047:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789778284.469054:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314908672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778284.469098:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778284.469136:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314908672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778284.469143:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789778284.469164:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789778284.469187:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98614e00 x1876718314908672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778284.469191:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778284.469204:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314908672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778284.469217:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314908928:0@lo:400:kworker.0 00000100:00100000:0.0:1789778284.469240:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778284.469250:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908416 00000100:00100000:3.0:1789778284.469253:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908416 00000100:00100000:0.0:1789778284.469282:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908928 00000100:00100000:0.0:1789778284.469286:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908928 00000100:00100000:0.0:1789778284.469321:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789778284.469327:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314908928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778284.469361:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314908928:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778284.469368:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789778284.469387:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00010000:00080000:0.0:1789778284.469394:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ec16d3b80 x1876718314908928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789778300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778284.469395:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314908416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778284.469403:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314908928:0@lo:400:kworker.0 00000100:00100000:0.0:1789778284.469469:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314908416:0@lo:400:kworker.0 00000100:00100000:3.0:1789778284.469507:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314908416:12345-0@lo:400:kworker.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778284.469525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789778284.472687:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778284.472783:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314909056:0@lo:400:kworker.0 00000100:00100000:0.0:1789778284.472815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778284.479493:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314908544 00000100:00100000:1.0:1789778284.479507:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314908544 00000100:00100000:1.0:1789778284.479576:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909056 00000100:00100000:1.0:1789778284.479579:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909056 00000100:00100000:1.0:1789778284.479622:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789778284.479631:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314908544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778284.479716:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314908544:12345-0@lo:400:kworker.0 Request processed in 86us (7035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778284.479723:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789778284.479753:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789778284.479758:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314909056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778284.479783:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314909056:12345-0@lo:400:kworker.0 Request processed in 25us (6968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778284.479788:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789778284.479830:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314908544:0@lo:400:kworker.0 00000100:00100000:1.0:1789778284.479841:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314909056:0@lo:400:kworker.0 00000100:00080000:0.0:1789778284.481248:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778284.978586:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314909312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778284.978657:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778284.979098:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909312 00000100:00100000:0.0:1789778284.979107:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909312 00000100:00100000:0.0:1789778284.979163:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789778284.979173:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314909312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778284.979206:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778284.979429:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314909312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778284.979437:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789778284.985380:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314909312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778285.239557:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778285.324640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778285.324689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778285.324735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778285.324772:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998976 00000100:00100000:1.0:1789778285.324784:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998976 00000100:00100000:1.0:1789778285.324864:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295999104 00000100:00100000:1.0:1789778285.324869:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295999104 00000100:00100000:1.0:1789778285.324894:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:1.0:1789778285.324904:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295998976:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778285.324977:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295998976:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 74us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778285.324996:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:1.0:1789778285.325017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:1.0:1789778285.325023:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295999104:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778285.325053:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295999104:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778285.325059:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00080000:1.0:1789778285.325122:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778285.325528:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295998848 00000100:00100000:3.0:1789778285.325536:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295998848 00000100:00100000:3.0:1789778285.325576:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 283 00000100:00100000:3.0:1789778285.325584:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295998848:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778285.325618:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295998848:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 36us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778285.325624:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 283 00010000:00010000:2.0:1789778286.258380:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778287.283373:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778288.307243:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789778288.627436:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789778289.322803:0:11850:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:38:08 (1789778288) 00010000:00010000:3.0:1789778289.330783:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778289.585371:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314909440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778289.585446:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778289.585511:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314909824:0@lo:400:kworker.0 00000100:00100000:0.0:1789778289.585517:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314909952:0@lo:400:kworker.0 00000100:00100000:0.0:1789778289.585543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778289.585561:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314909696:0@lo:400:kworker.0 00000100:00100000:0.0:1789778289.585580:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789778289.585586:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314909568:0@lo:400:kworker.0 00000100:00100000:1.0:1789778289.585587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778289.585614:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778289.585624:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909952 00000100:00100000:1.0:1789778289.585631:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909952 00000100:00100000:0.0:1789778289.585631:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314910080:0@lo:400:kworker.0 00000100:00100000:0.0:1789778289.585653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778289.585675:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778289.585684:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909696 00000100:00100000:1.0:1789778289.585687:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909696 00000100:00100000:0.0:1789778289.585698:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909824 00000100:00100000:0.0:1789778289.585701:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909824 00000100:00100000:1.0:1789778289.585705:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789778289.585712:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314909952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778289.585718:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789778289.585735:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314909696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778289.585760:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314909952:12345-0@lo:400:kworker.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778289.585761:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314909696:12345-0@lo:400:kworker.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778289.585767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789778289.585819:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909440 00000100:00100000:3.0:1789778289.585823:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909440 00000100:00100000:3.0:1789778289.585863:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789778289.585871:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314909440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778289.585898:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778289.585964:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314909440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778289.585970:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789778289.586009:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789778289.586029:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789778289.587554:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314909568 00000100:00100000:2.0:1789778289.587566:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314909568 00000100:00100000:2.0:1789778289.587614:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789778289.587623:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314909568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778289.587683:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314909568:12345-0@lo:400:kworker.0 Request processed in 61us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778289.587702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789778289.587781:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314909824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778289.587894:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314909824:12345-0@lo:400:kworker.0 Request processed in 1858us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778289.587910:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1789778289.587934:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789778289.587939:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778289.587981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314909568:0@lo:400:kworker.0 00000100:00100000:1.0:1789778289.587997:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314909952:0@lo:400:kworker.0 00010000:00080000:1.0:1789778289.588011:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3e98614e00 x1876718314909440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778289.588029:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314909440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778289.588115:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314909696:0@lo:400:kworker.0 00000100:00100000:1.0:1789778289.591685:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314910080 00000100:00100000:1.0:1789778289.591701:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314910080 00000100:00100000:1.0:1789778289.591788:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789778289.591799:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314910080:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789778289.592657:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778289.593325:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314910080:0@lo:400:kworker.0 00000100:00100000:1.0:1789778289.593442:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314910080:12345-0@lo:400:kworker.0 Request processed in 1213us (7354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778289.593452:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789778289.593729:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314909824:0@lo:400:kworker.0 00000100:00100000:3.0:1789778290.097575:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789778290.097600:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778290.097668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778290.097798:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314910208 00000100:00100000:0.0:1789778290.097807:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314910208 00000100:00100000:0.0:1789778290.097869:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789778290.097879:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314910208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778290.097924:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778290.097974:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314910208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778290.097981:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789778290.098028:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314910208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789778290.353757:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778290.446191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778290.446248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778290.446290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778290.446434:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295999232 00000100:00100000:1.0:1789778290.446446:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295999232 00000100:00100000:1.0:1789778290.446499:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 285 00000100:00100000:1.0:1789778290.446509:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295999232:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778290.446574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718295999232:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 66us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778290.446582:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 285 00000100:00100000:2.0:1789778290.448363:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295999488 00000100:00100000:2.0:1789778290.448380:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295999488 00000100:00100000:2.0:1789778290.448571:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295999360 00000100:00100000:2.0:1789778290.448576:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295999360 00000100:00100000:3.0:1789778290.448638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:3.0:1789778290.448650:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295999488:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778290.448743:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718295999488:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 96us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778290.448751:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00080000:1.0:1789778290.452112:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778290.452344:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:2.0:1789778290.452358:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295999360:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778290.452557:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718295999360:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 201us (6264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778290.452565:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:3.0:1789778291.366706:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778291.366892:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295999616 00000100:00100000:1.0:1789778291.366902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295999616 00000100:00100000:1.0:1789778291.367025:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:1.0:1789778291.367038:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:10261:x1876718295999616:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778291.367061:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778291.367131:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440fb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b59 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.367225:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157440fb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.367257:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157440fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.367271:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157440fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778291.367307:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789778291.367311:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778291.367360:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157440fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.367697:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157440fb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b59 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.367716:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157440fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b59 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.367724:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e91b87300) 00010000:00010000:1.0:1789778291.367727:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778291.367730:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321400, rc 0) 00000100:00100000:1.0:1789778291.367801:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:10261:x1876718295999616:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 767us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778291.367809:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00010000:00010000:2.0:1789778291.377533:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778291.377848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778291.377968:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718295999744 00000100:00100000:1.0:1789778291.377979:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718295999744 00000100:00100000:1.0:1789778291.378030:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:1.0:1789778291.378040:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:10262:x1876718295999744:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778291.378060:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778291.378111:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440fbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b60 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378185:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378200:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378452:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378471:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378479:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378486:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378703:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320c00/0x5a1e1c1157440fd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378712:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320c00/0x5a1e1c1157440fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378719:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320c00/0x5a1e1c1157440fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778291.378747:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789778291.378752:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778291.378771:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320c00/0x5a1e1c1157440fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378789:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378796:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378803:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378808:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778291.378813:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378820:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378832:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e91b87300) 00010000:00010000:1.0:1789778291.378835:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778291.378840:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378845:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157440fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378856:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378863:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378869:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378893:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778291.378896:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378902:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378910:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b3e91b87800) 00010000:00010000:1.0:1789778291.378912:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778291.378915:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378921:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440fcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378953:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157440fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b60 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378965:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320c00/0x5a1e1c1157440fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b60 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778291.378973:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3e91b87c00) 00010000:00010000:1.0:1789778291.378975:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778291.378978:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320c00, rc 0) 00000100:00100000:1.0:1789778291.380985:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:10262:x1876718295999744:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2932us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778291.380999:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1789778291.392712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778291.392811:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296000000 00000100:00100000:0.0:1789778291.392822:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296000000 00000100:00100000:0.0:1789778291.392897:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1789778291.392908:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:10262:x1876718296000000:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778291.392929:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778291.392952:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440fdb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b67 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393037:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393055:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393117:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393184:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393193:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393200:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393701:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157440ff0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393711:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157440ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393719:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157440ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778291.393730:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789778291.393897:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393905:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393912:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393919:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778291.393931:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393939:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393951:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3e91b87c00) 00010000:00010000:0.0:1789778291.393954:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778291.393959:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393966:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157440fe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393979:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393986:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393991:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.393996:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778291.393999:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.394005:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.394012:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778291.394014:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778291.394024:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.394030:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157440fe9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.396371:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157440fdb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b67 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.396474:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157440ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b67 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778291.396483:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:0.0:1789778291.396486:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778291.396491:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756e00, rc 0) 00000100:00100000:0.0:1789778291.397269:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10262:x1876718296000000:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 4356us (4562us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789778291.397280:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:2.0:1789778291.413684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778291.413786:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296000128 00000100:00100000:1.0:1789778291.413810:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296000128 00000100:00100000:1.0:1789778291.413883:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:1.0:1789778291.413894:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10262:x1876718296000128:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789778291.414019:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10262:x1876718296000128:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 127us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778291.414027:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000040:00080000:0.0:1789778291.706145:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789778292.412994:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778293.418270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778293.418339:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296000256 00000100:00100000:1.0:1789778293.418350:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296000256 00000100:00100000:1.0:1789778293.418424:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:1.0:1789778293.418435:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10304:x1876718296000256:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778293.418455:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778293.418475:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b6e expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418536:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418551:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418566:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418582:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418589:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418595:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418830:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418850:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418856:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418862:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778293.418866:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418873:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418886:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e91b87300) 00010000:00010000:1.0:1789778293.418888:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778293.418893:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418899:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418911:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418916:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418921:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418934:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778293.418937:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418944:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418952:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b3e91b87800) 00010000:00010000:1.0:1789778293.418955:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778293.418957:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418963:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744100c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.418995:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440ffe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b6e expref: 10 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.419005:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e91b87300) 00010000:00010000:1.0:1789778293.419008:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778293.419011:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c1157440ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b6e expref: 10 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778293.419020:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321800, rc 0) 00000100:00100000:1.0:1789778293.419124:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10304:x1876718296000256:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 690us (862us total) trans 0 rc 301/301 00000100:00100000:1.0:1789778293.419132:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00080000:0.0:1789778293.419578:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778293.433345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.433523:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296000512 00000100:00100000:2.0:1789778293.433535:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296000512 00000100:00100000:2.0:1789778293.433590:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1789778293.433601:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10304:x1876718296000512:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:2.0:1789778293.433655:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778293.433681:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157440fb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b59 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.433698:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e91b87300) 00010000:00010000:2.0:1789778293.433708:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778293.433948:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.433962:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.433971:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.433982:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.433989:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.433994:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778293.434850:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789778293.434862:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.434869:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.434875:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.434880:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778293.434884:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.434891:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.434909:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:2.0:1789778293.434912:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778293.434915:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.434921:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441013 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778293.434938:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019fb4a59 reply state 0000000038c01c06 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778293.434958:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778293.435097:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:10304:x1876718296000512:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 1467us (1733us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789778293.435106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00010000:00010000:1.0:1789778293.441214:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778293.448019:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.448038:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.448045:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.448051:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778293.448055:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.448090:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.448124:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b3e922c1900) 00010000:00010000:2.0:1789778293.448126:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778293.448144:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.448150:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744101a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778293.528629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.528671:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296000640 00000100:00100000:2.0:1789778293.528681:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296000640 00000100:00100000:2.0:1789778293.528733:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1789778293.528743:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10312:x1876718296000640:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:2.0:1789778293.528768:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778293.528791:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b75 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.528885:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.528900:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.528912:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778293.528947:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778293.528951:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778293.528987:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.529018:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b75 expref: 11 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.529034:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b75 expref: 10 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.529042:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778293.529045:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778293.529049:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9000, rc 0) 00000100:00100000:2.0:1789778293.529124:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:10312:x1876718296000640:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 382us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778293.529131:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:1.0:1789778293.606606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.607384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296000768 00000100:00100000:2.0:1789778293.607397:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296000768 00000100:00100000:2.0:1789778293.607468:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1789778293.607489:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:10318:x1876718296000768:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778293.607510:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778293.607532:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744102f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b7c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607710:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607725:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607737:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607768:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607776:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607783:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607965:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157441044 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607975:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157441044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.607982:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157441044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778293.608014:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789778293.608018:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778293.608113:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157441044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608128:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608320:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608327:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608345:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778293.608350:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608359:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608373:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778293.608376:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778293.608383:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608389:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608406:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608412:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608418:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608423:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778293.608426:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608432:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608452:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b3e922c1f00) 00010000:00010000:2.0:1789778293.608455:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778293.608458:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608463:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744103d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608690:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744102f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b7c expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608705:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157441044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b7c expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.608712:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778293.608714:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789778293.608716:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8c00, rc 0) 00000100:00100000:3.0:1789778293.615380:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:10318:x1876718296000768:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5628us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778293.615406:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:0.0:1789778293.620667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.620897:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296001024 00000100:00100000:2.0:1789778293.620907:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296001024 00000100:00100000:2.0:1789778293.620974:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:2.0:1789778293.620985:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:10318:x1876718296001024:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778293.621007:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778293.621026:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744104b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b83 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.621349:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.621383:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.621394:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.621454:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.621462:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.621468:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789778293.623967:0:8093:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789778293.624378:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624395:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624421:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624461:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624468:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624475:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624480:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778293.624484:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624492:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624504:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778293.624507:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778293.624512:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624517:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441052 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789778293.624531:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba636d5d reply state 0000000097b123af transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778293.624539:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789778293.624584:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744104b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 14 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624673:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 13 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.624681:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a700) 00010000:00010000:0.0:1789778293.624683:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778293.624686:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756c00, rc 0) 00000100:00100000:0.0:1789778293.624766:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10318:x1876718296001024:12345-192.168.201.45@tcp:101:bash.0 Request processed in 3783us (4109us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789778293.624782:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:1.0:1789778293.633111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.633305:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296001152 00000100:00100000:2.0:1789778293.633318:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296001152 00000100:00100000:2.0:1789778293.633374:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:2.0:1789778293.633382:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1876718296001152:12345-192.168.201.45@tcp:8:bash.0 00010000:00080000:2.0:1789778293.633416:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:2.0:1789778293.633448:0:6691:0:(genops.c:1385:class_connect()) connect: client bdd103b9-ae1a-4bf0-9cc3-bcece875c39a, cookie 0x5a1e1c115744106e 00002000:00100000:2.0:1789778293.633460:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bdd103b9-ae1a-4bf0-9cc3-bcece875c39a/ffff9b3ebfe32000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789778293.633601:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789778293.633881:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789778293.633917:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9b3ebfe37800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778293.634002:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2371:x1876718296001152:12345-192.168.201.45@tcp:8:bash.0 Request processed in 617us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778293.634010:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00010000:00010000:0.0:1789778293.637152:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.637172:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.637181:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.637187:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778293.637193:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.637200:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.637221:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e922c1f00) 00010000:00010000:0.0:1789778293.637224:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778293.637248:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.637256:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441059 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778293.652518:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778293.652796:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296001280 00000100:00100000:3.0:1789778293.652807:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296001280 00000100:00100000:3.0:1789778293.652898:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1789778293.652909:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:0:x1876718296001280:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1789778293.652927:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778293.652953:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b8a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778293.652982:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778293.653003:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1789778293.653009:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778293.653018:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.653040:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.653054:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f200, rc 0) 00000100:00080000:0.0:1789778293.653404:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778293.653687:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:0:x1876718296001280:12345-192.168.201.45@tcp:101:bash.0 Request processed in 777us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778293.653695:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1789778293.661261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.661427:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296001408 00000100:00100000:2.0:1789778293.661437:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296001408 00000100:00100000:2.0:1789778293.661507:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:2.0:1789778293.661518:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:10318:x1876718296001408:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778293.661537:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778293.661560:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b91 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.661591:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.661601:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778293.661605:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778293.661611:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.661645:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.661659:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 8 pid: 6694 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778293.661673:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876718314910336:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778293.661805:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9747300 going to sleep for 11 seconds 00000100:00100000:1.0:1789778293.668205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778293.668300:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296001536 00000100:00100000:0.0:1789778293.668311:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296001536 00010000:00010000:0.0:1789778293.668352:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 9 pid: 6694 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778293.668397:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:0.0:1789778293.668409:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296001536:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778293.668425:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778293.668448:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 9 pid: 6694 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.668464:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 9 pid: 6694 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.668494:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778293.668499:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778293.668508:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.668518:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778293.668571:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778293.668586:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1440700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1876718314910464:192.168.201.45@tcp:105: 00000100:00100000:0.0:1789778293.668676:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2c00 going to sleep for 11 seconds 00010000:00010000:2.0:1789778293.669118:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000888fdf6d/0x5a1e1c1157441075 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b8a expref: 9 pid: 6694 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778293.669146:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876718314910336:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778293.669175:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.669186:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9600, rc 0) 00000100:00100000:2.0:1789778293.669219:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:10318:x1876718296001408:12345-192.168.201.45@tcp:101:bash.0 Request processed in 7703us (7969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778293.669228:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1789778293.677977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778293.678123:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296001792 00000100:00100000:3.0:1789778293.678144:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296001792 00000100:00100000:3.0:1789778293.678204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:3.0:1789778293.678215:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10318:x1876718296001792:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:3.0:1789778293.678999:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10318:x1876718296001792:12345-192.168.201.45@tcp:35:bash.0 Request processed in 783us (1030us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789778293.679008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1789778293.685886:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1440700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1876718314910464:192.168.201.45@tcp:105: 00010000:00010000:0.0:1789778293.685921:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778293.686004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296001536:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 17597us (17808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778293.686016:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:1.0:1789778293.805836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778293.805973:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296002048 00000100:00100000:3.0:1789778293.805984:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296002048 00000100:00100000:3.0:1789778293.806053:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1789778293.806098:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10328:x1876718296002048:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778293.806125:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778293.806158:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c1157441083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b98 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778293.806258:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789778293.806388:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c1157441083 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b98 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.806402:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:3.0:1789778293.806404:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789778293.806409:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c1157441083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b98 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.806422:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f600, rc 0) 00000100:00100000:3.0:1789778293.806485:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10328:x1876718296002048:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 411us (656us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789778293.806508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:3.0:1789778293.809582:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.809674:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296002304 00000100:00100000:2.0:1789778293.809685:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296002304 00000100:00100000:2.0:1789778293.809737:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1789778293.809748:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10328:x1876718296002304:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778293.810009:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:10328:x1876718296002304:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 261us (435us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789778293.810016:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778293.893650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778293.893757:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296002432 00000100:00100000:3.0:1789778293.893771:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296002432 00000100:00100000:3.0:1789778293.893870:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1789778293.893881:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:10334:x1876718296002432:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778293.893910:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778293.893933:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c1157441091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7b9f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.894018:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ee00/0x5a1e1c1157441098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.894035:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ee00/0x5a1e1c1157441098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.894048:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ee00/0x5a1e1c1157441098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778293.894140:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789778293.894144:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789778293.894167:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ee00/0x5a1e1c1157441098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.894195:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c1157441091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b9f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.894219:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ee00/0x5a1e1c1157441098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b9f expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.894249:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778293.894252:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789778293.894257:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150ee00, rc 0) 00000100:00100000:3.0:1789778293.894336:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:10334:x1876718296002432:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 456us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778293.894345:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1789778293.907837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778293.907969:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296002688 00000100:00100000:3.0:1789778293.907980:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296002688 00000100:00100000:3.0:1789778293.908149:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:3.0:1789778293.908160:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:10334:x1876718296002688:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778293.908181:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778293.908388:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c115744109f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ba6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.908566:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f000/0x5a1e1c11574410a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.908583:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f000/0x5a1e1c11574410a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.908595:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f000/0x5a1e1c11574410a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778293.908605:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789778293.908799:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c115744109f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ba6 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.908852:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f000/0x5a1e1c11574410a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ba6 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.908860:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a700) 00010000:00010000:3.0:1789778293.908863:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778293.908867:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f000, rc 0) 00000100:00100000:3.0:1789778293.908981:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10334:x1876718296002688:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 822us (1167us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789778293.908989:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1789778293.913675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778293.913721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778293.913796:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296002944 00000100:00100000:3.0:1789778293.913807:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296002944 00000100:00100000:3.0:1789778293.913883:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1789778293.913892:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10334:x1876718296002944:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778293.913917:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778293.913940:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c11574410b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bad expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.914104:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c11574410bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.914119:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c11574410bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.914132:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c11574410bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778293.914146:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789778293.914295:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f200/0x5a1e1c11574410b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bad expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.914313:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c11574410bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bad expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.914322:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a700) 00010000:00010000:3.0:1789778293.914325:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789778293.914328:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c800, rc 0) 00000100:00100000:3.0:1789778293.914404:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10334:x1876718296002944:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 512us (738us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789778293.914412:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:2.0:1789778293.914992:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296003072 00000100:00100000:2.0:1789778293.914999:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296003072 00000100:00100000:2.0:1789778293.915046:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1789778293.915054:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:2374:x1876718296003072:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778293.915083:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778293.915100:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f000/0x5a1e1c11574410a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ba6 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.915122:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a700) 00010000:00010000:2.0:1789778293.915126:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778293.915158:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:2374:x1876718296003072:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 104us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778293.915165:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:1.0:1789778293.935556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778293.935711:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296003200 00000100:00100000:3.0:1789778293.935721:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296003200 00000100:00100000:3.0:1789778293.935792:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:3.0:1789778293.935804:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2373:x1876718296003200:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:3.0:1789778293.935863:0:8205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.935886:0:8205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.935896:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778293.935900:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789778293.935905:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.935942:0:8205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778293.935973:0:8205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 7 pid: 6691 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778293.935988:0:8205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314910592:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778293.936117:0:8205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e8503f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789778293.942759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778293.942868:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296003328 00000100:00100000:2.0:1789778293.942878:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296003328 00002000:00100000:2.0:1789778293.942921:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b3ec1440380 x1876718296003328/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:219/0 lens 504/0 e 0 to 0 dl 1789778304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789778293.942933:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec1440380 with x1876718296003328 ext(0->12) 00010000:00010000:2.0:1789778293.942943:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 8 pid: 6691 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778293.942960:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 8 pid: 6691 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778293.942969:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3ec1440380 00000100:00100000:2.0:1789778293.943000:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1789778293.943009:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296003328:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:3.0:1789778293.944679:0:8205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314910592:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778293.944710:0:8205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789778294.051939:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000100:00100000:3.0:1789778294.089833:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296003328:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 146804us (147064us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789778294.089855:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00002000:00100000:3.0:1789778294.089868:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b3ec1440380 x1876718296003328/t4294967299(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:219/0 lens 504/448 e 0 to 0 dl 1789778304 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789778294.089879:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec1440380 with x1876718296003328 ext(0->12) 00010000:00010000:3.0:1789778294.089889:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 9 pid: 6691 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.089905:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 9 pid: 6691 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778294.089913:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3ec1440380 00000001:00080000:3.0:1789778294.089950:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1789778294.095331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778294.095488:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296003456 00000100:00100000:0.0:1789778294.095499:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296003456 00010000:00010000:0.0:1789778294.095539:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 7 pid: 6691 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778294.095581:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:0.0:1789778294.095590:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296003456:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778294.095604:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789778294.095622:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789778294.095625:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789778293 00002000:00010000:0.0:1789778294.095628:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789778294 00002000:00010000:0.0:1789778294.095646:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789778293 00002000:00010000:0.0:1789778294.095647:0:5832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1789778294.095654:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 7 pid: 6691 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778294.095668:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 7 pid: 6691 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778294.095695:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c115744107c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b91 expref: 7 pid: 6691 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778294.095716:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1789778294.095720:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778294.095735:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778294.095745:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778294.095780:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778294.095868:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296003456:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 278us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778294.095876:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00010000:00010000:3.0:1789778294.096431:0:8205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096443:0:8205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096482:0:8205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096492:0:8205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096501:0:8205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096508:0:8205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778294.096513:0:8205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096522:0:8205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096536:0:8205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.096544:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c11574410c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778294.096628:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718296003200:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 160826us (161081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778294.096637:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:1.0:1789778294.106879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778294.107008:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296003712 00000100:00100000:2.0:1789778294.107019:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296003712 00000100:00100000:2.0:1789778294.107102:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:2.0:1789778294.107112:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:10334:x1876718296003712:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:2.0:1789778294.107195:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c11574410bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bad expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789778294.107470:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789778294.107531:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789778294.108046:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789778294.108126:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.108141:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 24 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.108151:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.108184:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 24 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.108200:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 24 pid: 8093 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778294.108214:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314910720:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778294.108309:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9747840 going to sleep for 11 seconds 00000100:00100000:2.0:1789778294.115698:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314910720:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778294.115731:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778294.118758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.118866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296003840 00000100:00100000:3.0:1789778294.118880:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296003840 00010000:00010000:3.0:1789778294.118924:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 25 pid: 8093 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778294.118969:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:3.0:1789778294.118979:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+25:2374:x1876718296003840:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778294.118993:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778294.119000:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 25 pid: 8093 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.119014:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 25 pid: 8093 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.119037:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b83 expref: 25 pid: 8093 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.119055:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a700) 00010000:00010000:3.0:1789778294.119061:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.119139:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.119165:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.119191:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778294.119245:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:2374:x1876718296003840:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 267us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778294.119254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00010000:00010000:1.0:1789778294.120299:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778294.120313:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789778294.120434:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789778294.120651:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789778294.120759:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec178a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314910848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789778294.120861:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778294.120898:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9097d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778294.121040:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314910848 00000100:00100000:2.0:1789778294.121048:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314910848 00000100:00100000:2.0:1789778294.121153:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778294.121163:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314910848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789778294.121244:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314910848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.121250:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789778294.121372:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778294.122650:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec178a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314910848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789778294.123839:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789778294.123928:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec178a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314910976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789778294.123987:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778294.124100:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eabb95c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789778294.125655:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314910976 00000100:00100000:2.0:1789778294.125668:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314910976 00000100:00100000:2.0:1789778294.126034:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778294.126047:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314910976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789778294.126410:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876718314910976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 364us (2422us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789778294.126419:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789778294.126537:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec178a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314910976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789778294.126615:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789778294.126663:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778294.126676:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778294.126683:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778294.126690:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778294.126695:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778294.126703:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778294.126718:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a700) 00010000:00010000:1.0:1789778294.126721:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789778294.127291:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778294.127299:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574410d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789778294.131009:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789778294.131392:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789778294.131404:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349089338548ns, next at 350089335563ns, rc = 0 00000001:00080000:1.0:1789778294.131414:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789778294.131611:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a700) 00010000:00010000:1.0:1789778294.131616:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789778294.131626:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c11574410bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bad expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778294.134240:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10334:x1876718296003712:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 27117us (27361us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789778294.134260:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000020:00080000:1.0:1789778294.134269:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789778294.142814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.142911:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296003968 00000100:00100000:3.0:1789778294.142922:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296003968 00000100:00100000:3.0:1789778294.142986:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:3.0:1789778294.142998:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10334:x1876718296003968:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778294.143026:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778294.143050:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574410d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bb4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.143240:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574410d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bb4 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.143255:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574410d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bb4 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.143275:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778294.143278:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789778294.143281:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d800, rc 0) 00000100:00100000:3.0:1789778294.143341:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:10334:x1876718296003968:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 345us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778294.143348:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:1.0:1789778294.151812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.152025:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296004224 00000100:00100000:3.0:1789778294.152038:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296004224 00000100:00100000:3.0:1789778294.152242:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:3.0:1789778294.152254:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e867b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:10334:x1876718296004224:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778294.152680:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e867b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:10334:x1876718296004224:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 428us (879us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789778294.152686:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1789778294.262037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.262164:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296004480 00000100:00100000:3.0:1789778294.262175:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296004480 00000100:00100000:3.0:1789778294.262228:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:3.0:1789778294.262237:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:10344:x1876718296004480:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778294.262263:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778294.262283:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c11574410de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bbb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778294.262373:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789778294.262501:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c11574410de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bbb expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.262516:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:3.0:1789778294.262519:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789778294.262524:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c11574410de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bbb expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.262536:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c000, rc 0) 00000100:00100000:3.0:1789778294.262598:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:10344:x1876718296004480:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 362us (571us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789778294.262622:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1789778294.272167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778294.272348:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296004608 00000100:00100000:2.0:1789778294.272359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296004608 00000100:00100000:2.0:1789778294.272421:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:2.0:1789778294.272429:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:10344:x1876718296004608:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1789778294.272503:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272520:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272532:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272547:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272553:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272577:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272666:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272674:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272682:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778294.272739:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272752:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272760:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272767:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272773:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778294.272777:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272784:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272795:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778294.272804:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778294.272809:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272815:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574410ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272839:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272845:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272850:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272853:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778294.272856:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272861:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272868:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e922c1800) 00010000:00010000:2.0:1789778294.272870:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778294.272873:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272878:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574410f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272891:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272903:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272907:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272912:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778294.272914:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272920:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272927:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778294.272929:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778294.272931:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.272937:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574410fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778294.273006:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:10344:x1876718296004608:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 576us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.273014:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:1.0:1789778294.281220:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778294.281354:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296004864 00000100:00100000:2.0:1789778294.281370:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296004864 00000100:00100000:2.0:1789778294.281450:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1789778294.281461:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:10344:x1876718296004864:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778294.281829:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:10344:x1876718296004864:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 358us (614us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789778294.281852:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1789778294.356602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.357110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296005120 00000100:00100000:3.0:1789778294.357133:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296005120 00000100:00100000:3.0:1789778294.357200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:3.0:1789778294.357211:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:10347:x1876718296005120:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778294.357239:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778294.357381:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441101 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bc2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357478:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357492:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357504:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357518:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357525:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357532:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357650:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357675:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357683:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778294.357694:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789778294.357799:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357807:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357814:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357830:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44ca00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778294.357834:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357842:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357856:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778294.357858:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778294.357862:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357869:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441108 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357885:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357897:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357903:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357908:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44ce00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778294.357911:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357918:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357925:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5900) 00010000:00010000:3.0:1789778294.357928:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778294.357947:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357953:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c115744110f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.357999:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.358013:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.358021:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778294.358024:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778294.358035:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c400, rc 0) 00000100:00100000:3.0:1789778294.358550:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:10347:x1876718296005120:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1339us (1956us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789778294.358558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:0.0:1789778294.367634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778294.367890:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296005248 00000100:00100000:2.0:1789778294.367903:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296005248 00000100:00100000:2.0:1789778294.367971:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1789778294.367984:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:10347:x1876718296005248:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1789778294.368062:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368111:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368137:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368165:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368172:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368179:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368185:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778294.368189:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368196:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368208:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778294.368225:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778294.368230:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.368237:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778294.368319:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:10347:x1876718296005248:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 338us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.368327:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:1.0:1789778294.372524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.372612:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296005504 00000100:00100000:3.0:1789778294.372625:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296005504 00000100:00100000:3.0:1789778294.372682:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1789778294.372691:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:10347:x1876718296005504:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778294.373124:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:10347:x1876718296005504:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 425us (602us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789778294.373133:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00010000:00010000:2.0:1789778294.450948:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778294.705480:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778294.705515:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314911104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778294.705602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778294.706661:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314911488:0@lo:400:kworker.0 00000100:00100000:2.0:1789778294.706707:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778294.706749:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778294.706756:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314911616:0@lo:400:kworker.0 00000100:00100000:2.0:1789778294.706777:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778294.706804:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314911488 00000100:00100000:2.0:1789778294.706824:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314911488 00000100:00100000:2.0:1789778294.706882:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314911616 00000100:00100000:2.0:1789778294.706886:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314911616 00000100:00100000:2.0:1789778294.706910:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789778294.706919:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314911488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778294.707005:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314911488:12345-0@lo:400:kworker.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.707012:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789778294.707029:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789778294.707035:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314911616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778294.707087:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314911616:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.707102:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789778294.707121:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778294.707151:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314911616:0@lo:400:kworker.0 00000100:00100000:2.0:1789778294.707162:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314911488:0@lo:400:kworker.0 00000100:00100000:3.0:1789778294.707386:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314911360:0@lo:400:kworker.0 00000100:00100000:3.0:1789778294.707417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778294.707443:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789778294.707450:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314911232:0@lo:400:kworker.0 00000100:00100000:3.0:1789778294.707480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778294.707503:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314911744:0@lo:400:kworker.0 00000100:00100000:3.0:1789778294.707528:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778294.707571:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314911744 00000100:00100000:3.0:1789778294.707575:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314911744 00000100:00100000:3.0:1789778294.707611:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789778294.707618:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314911744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778294.707655:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314911744:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778294.707661:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789778294.707677:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778294.707693:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314911360 00000100:00100000:3.0:1789778294.707696:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314911360 00000100:00100000:3.0:1789778294.707719:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789778294.707725:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314911360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778294.707754:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314911360:12345-0@lo:400:kworker.0 Request processed in 30us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778294.707760:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789778294.707783:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314911744:0@lo:400:kworker.0 00000100:00100000:3.0:1789778294.707794:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314911360:0@lo:400:kworker.0 00000100:00100000:2.0:1789778294.707937:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314911232 00000100:00100000:2.0:1789778294.707941:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314911232 00000100:00100000:2.0:1789778294.707979:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789778294.707986:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314911232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778294.708019:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314911232:12345-0@lo:400:kworker.0 Request processed in 34us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.708025:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789778294.708455:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314911232:0@lo:400:kworker.0 00000100:00100000:0.0:1789778294.708542:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314911104 00000100:00100000:0.0:1789778294.708548:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314911104 00000100:00100000:0.0:1789778294.708648:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789778294.708655:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314911104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778294.708675:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789778294.708727:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314911104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778294.708733:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789778294.708805:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314911104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778294.710637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.710784:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296005760 00000100:00100000:3.0:1789778294.710793:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296005760 00000100:00100000:3.0:1789778294.710868:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1789778294.710879:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:10378:x1876718296005760:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1789778294.710905:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778294.710927:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c115744112b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bc9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.711049:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441132 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.711084:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.711097:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778294.711121:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789778294.711313:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c115744112b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc9 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.711331:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc9 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.711339:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778294.711342:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778294.711345:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44ce00, rc 0) 00000100:00100000:3.0:1789778294.711403:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:10378:x1876718296005760:12345-192.168.201.45@tcp:101:cat.0 Request processed in 526us (773us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789778294.711410:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1789778294.717938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778294.718087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778294.718273:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296006144 00000100:00100000:1.0:1789778294.718285:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296006144 00000100:00100000:1.0:1789778294.718353:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778294.718366:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:10378:x1876718296006144:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:1.0:1789778294.718879:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:10378:x1876718296006144:12345-192.168.201.45@tcp:35:cat.0 Request processed in 512us (811us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789778294.718888:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:2.0:1789778294.719315:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296005888 00000100:00100000:2.0:1789778294.719322:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296005888 00000100:00100000:2.0:1789778294.719417:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:2.0:1789778294.719427:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:2375:x1876718296005888:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778294.719440:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778294.719480:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441132 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc9 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.719510:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778294.719516:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778294.719549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:2375:x1876718296005888:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 124us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.719706:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1789778294.801033:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.802931:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296006400 00000100:00100000:3.0:1789778294.802949:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296006400 00000100:00100000:3.0:1789778294.803021:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:3.0:1789778294.803032:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:10384:x1876718296006400:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:3.0:1789778294.803056:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778294.803060:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789778294.803102:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ee00/0x5a1e1c1157441098 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b9f expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.803799:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778294.803804:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778294.803831:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441140 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bd0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.803939:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.803972:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.803980:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.804013:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.804028:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 36 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778294.804041:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314911872:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778294.804245:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789778294.815474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778294.818411:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296006528 00000100:00100000:2.0:1789778294.818428:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296006528 00010000:00010000:2.0:1789778294.818491:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 37 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778294.818542:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1789778294.818562:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:2375:x1876718296006528:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778294.818578:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778294.818585:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 37 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.818599:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 37 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.818623:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778294.818628:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.818638:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.818644:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.818663:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778294.818741:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:2375:x1876718296006528:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 175us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778294.818767:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00010000:00010000:3.0:1789778294.826967:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441116 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bc2 expref: 36 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778294.826995:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314911872:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778294.827023:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.827034:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.827040:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778294.827079:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789778294.828617:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441140 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.828643:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.828652:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778294.828655:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789778294.828658:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44ca00, rc 0) 00000100:00100000:2.0:1789778294.828851:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:10384:x1876718296006400:12345-192.168.201.45@tcp:101:dd.0 Request processed in 25820us (27828us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789778294.828860:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:1.0:1789778294.841636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778294.841715:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296006784 00000100:00100000:3.0:1789778294.841737:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296006784 00000100:00100000:3.0:1789778294.841796:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:3.0:1789778294.841807:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:10384:x1876718296006784:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:3.0:1789778294.842145:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.842162:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778294.842174:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778294.842262:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789778294.842291:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007db972f2 reply state 00000000c5ca6ccf transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778294.842300:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778294.842387:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:10384:x1876718296006784:12345-192.168.201.45@tcp:36:dd.0 Request processed in 581us (761us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789778294.842396:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000020:00080000:3.0:1789778294.842400:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789778294.844775:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.844792:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.844799:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.844807:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778294.844821:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.844830:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.844862:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778294.844865:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778294.844870:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778294.844876:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441155 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778295.050781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778295.050926:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296006912 00000100:00100000:2.0:1789778295.050936:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296006912 00000100:00100000:2.0:1789778295.051032:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:2.0:1789778295.051040:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:10398:x1876718296006912:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:2.0:1789778295.051087:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778295.051110:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744115c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bd7 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051191:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051203:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051214:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051223:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051237:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051262:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051330:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051337:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051343:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051371:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.051380:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 39 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778295.051390:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314912000:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778295.051567:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9747600 going to sleep for 11 seconds 00000100:00080000:3.0:1789778295.052115:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778295.053416:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314912000:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778295.053727:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778295.054025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.054521:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296007168 00000100:00100000:3.0:1789778295.054530:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296007168 00000100:00100000:3.0:1789778295.054601:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1789778295.054612:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+40:5626:x1876718296007168:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789778295.054941:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:5626:x1876718296007168:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 329us (916us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789778295.054949:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1789778295.057194:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778295.057371:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296007296 00000100:00100000:2.0:1789778295.057381:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296007296 00010000:00010000:2.0:1789778295.057584:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 41 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778295.057683:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1789778295.057691:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:2374:x1876718296007296:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778295.057702:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778295.057708:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 41 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.057717:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 41 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.057735:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441147 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd0 expref: 41 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.057746:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778295.057750:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.057756:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.057761:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.057784:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778295.057826:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057834:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778295.057855:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+40:2374:x1876718296007296:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 164us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778295.057862:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000004:00200000:3.0:1789778295.057875:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789778295.057879:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789778295.057919:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057932:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057941:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057947:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057953:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057959:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.057963:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057970:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057979:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778295.057982:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.057986:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.057999:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058011:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058017:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058022:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058027:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.058030:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058037:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058045:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e922c1800) 00010000:00010000:3.0:1789778295.058047:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.058050:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058056:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744116a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058490:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744115c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd7 expref: 40 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058506:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd7 expref: 39 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.058523:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.058525:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778295.058528:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8e00, rc 0) 00000100:00100000:3.0:1789778295.058570:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:10398:x1876718296006912:12345-192.168.201.45@tcp:101:stat.0 Request processed in 7530us (7797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778295.058577:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:1.0:1789778295.128984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.129094:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296007552 00000100:00100000:3.0:1789778295.129106:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296007552 00000100:00100000:3.0:1789778295.129185:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:3.0:1789778295.129196:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:10404:x1876718296007552:12345-192.168.201.45@tcp:36:truncate.0 00010000:00010000:3.0:1789778295.129256:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778295.129284:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bd7 expref: 39 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.129306:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.129311:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778295.129529:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.129544:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.129554:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778295.129609:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789778295.129636:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f07b67e8 reply state 00000000e732e0e2 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778295.129659:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778295.129836:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:10404:x1876718296007552:12345-192.168.201.45@tcp:36:truncate.0 Request processed in 640us (861us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789778295.129844:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000020:00080000:3.0:1789778295.129849:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789778295.140289:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.140328:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.140336:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.140342:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44da00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778295.140347:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.140355:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.140374:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778295.140377:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778295.140382:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.140387:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441178 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778295.217635:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314912128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778295.217715:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778295.218057:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314912128 00000100:00100000:1.0:1789778295.218089:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314912128 00000100:00100000:1.0:1789778295.218176:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789778295.218186:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314912128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789778295.218226:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778295.220728:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314912128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2531us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778295.220744:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789778295.223193:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314912128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778295.260864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.260990:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296007680 00000100:00100000:0.0:1789778295.261004:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296007680 00000100:00100000:0.0:1789778295.261092:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:0.0:1789778295.261113:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+40:10418:x1876718296007680:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:0.0:1789778295.261348:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778295.261372:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744117f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bde expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261438:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261453:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261463:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261480:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261487:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261509:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261601:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261609:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261616:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778295.261657:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789778295.261662:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778295.261686:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261697:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261705:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261711:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261718:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261723:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778295.261727:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261741:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261754:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778295.261757:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778295.261762:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261768:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441186 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261781:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261786:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261791:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261796:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778295.261799:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261816:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261824:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3ea4c7a100) 00010000:00010000:0.0:1789778295.261827:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778295.261830:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261848:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744118d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261881:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744117f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261894:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.261901:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:0.0:1789778295.261903:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778295.261906:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756c00, rc 0) 00000100:00100000:0.0:1789778295.261980:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:10418:x1876718296007680:12345-192.168.201.45@tcp:101:stat.0 Request processed in 878us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778295.261988:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:0.0:1789778295.360871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778295.361005:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296007936 00000100:00100000:2.0:1789778295.361018:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296007936 00000100:00100000:2.0:1789778295.361267:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:2.0:1789778295.361278:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:10428:x1876718296007936:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778295.361301:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778295.361320:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c115744119b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7be5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778295.361436:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789778295.361812:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c115744119b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7be5 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.361831:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778295.361834:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778295.361839:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c115744119b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7be5 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.361856:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8400, rc 0) 00000100:00100000:2.0:1789778295.361932:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+42:10428:x1876718296007936:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 655us (1073us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789778295.361940:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:1.0:1789778295.366568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.366770:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296008192 00000100:00100000:3.0:1789778295.366781:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296008192 00000100:00100000:3.0:1789778295.366852:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1789778295.366864:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+42:10428:x1876718296008192:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778295.367147:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+43:10428:x1876718296008192:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 273us (576us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789778295.367155:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1789778295.456737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.457252:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296008448 00000100:00100000:0.0:1789778295.457263:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296008448 00000100:00100000:0.0:1789778295.457328:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:0.0:1789778295.457337:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+43:10434:x1876718296008448:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778295.457359:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778295.457376:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.457487:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.457522:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.457533:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.457576:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.457591:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 44 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778295.457605:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1441880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314912256:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778295.457722:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e8783ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789778295.464249:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1441880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314912256:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778295.464283:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.474747:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778295.475665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.475841:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296008576 00000100:00100000:3.0:1789778295.475853:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296008576 00010000:00010000:3.0:1789778295.475898:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 45 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778295.475943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1789778295.475952:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+45:2374:x1876718296008576:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778295.475968:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778295.475975:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 45 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.476008:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 45 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.476031:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bde expref: 45 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.476048:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.476052:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.476062:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.476260:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.476358:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778295.476414:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+44:2374:x1876718296008576:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 462us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778295.476422:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00010000:00010000:3.0:1789778295.476763:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.476772:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778295.476792:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789778295.476972:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.476990:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.477012:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.477015:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789778295.477017:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757200, rc 0) 00000100:00100000:3.0:1789778295.477125:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+44:10434:x1876718296008448:12345-192.168.201.45@tcp:101:bash.0 Request processed in 19788us (20403us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789778295.477133:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:1.0:1789778295.483791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.483920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296008832 00000100:00100000:3.0:1789778295.483933:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296008832 00000100:00100000:3.0:1789778295.484049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:3.0:1789778295.484061:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+44:10434:x1876718296008832:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:3.0:1789778295.484430:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.484448:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.484462:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778295.484520:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789778295.484546:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e2778f4 reply state 00000000ec139739 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778295.484555:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778295.484669:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10434:x1876718296008832:12345-192.168.201.45@tcp:36:bash.0 Request processed in 610us (886us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789778295.484677:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000020:00080000:3.0:1789778295.484690:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789778295.498522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.498676:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296008960 00000100:00100000:0.0:1789778295.498689:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296008960 00000100:00100000:0.0:1789778295.498764:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:0.0:1789778295.498775:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10434:x1876718296008960:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778295.498811:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778295.498835:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574411c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bf3 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.498923:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.498948:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.498955:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.498962:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.498980:0:8093:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.499004:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.499018:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 48 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778295.499032:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1441880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314912384:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778295.499265:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e8783ba80 going to sleep for 11 seconds 00010000:00010000:3.0:1789778295.499336:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.499345:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.499352:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.499358:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44dc00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.499361:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.499369:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.499384:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.499387:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.499390:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.499398:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.499404:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778295.506570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778295.506950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296009088 00000100:00100000:2.0:1789778295.506961:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296009088 00010000:00010000:2.0:1789778295.507008:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 48 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778295.507060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:2.0:1789778295.507121:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:2374:x1876718296009088:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778295.507295:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778295.507305:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 48 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.507318:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 48 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.507342:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:2.0:1789778295.507348:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.507358:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.507366:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778295.507387:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778295.508342:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:2374:x1876718296009088:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1219us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778295.508352:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00010000:00010000:0.0:1789778295.508560:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bec expref: 47 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778295.508591:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1441880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314912384:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778295.508620:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.508629:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.508651:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778295.508704:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789778295.508709:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778295.508733:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.508766:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574411c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bf3 expref: 47 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.508782:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bf3 expref: 46 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.508792:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:0.0:1789778295.508795:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778295.508813:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756600, rc 0) 00000100:00100000:0.0:1789778295.508857:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:10434:x1876718296008960:12345-192.168.201.45@tcp:101:bash.0 Request processed in 10084us (10347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778295.508865:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:2.0:1789778295.531345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.531459:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296009344 00000100:00100000:3.0:1789778295.531471:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296009344 00000100:00100000:3.0:1789778295.531535:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778295.531547:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:10434:x1876718296009344:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:3.0:1789778295.531850:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e867b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10434:x1876718296009344:12345-192.168.201.45@tcp:35:bash.0 Request processed in 303us (513us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789778295.531858:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778295.563625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.563668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.563702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.563872:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296009600 00000100:00100000:0.0:1789778295.563883:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296009600 00000100:00100000:0.0:1789778295.563953:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1789778295.563964:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718296009600:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778295.564034:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718296009600:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778295.564042:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00080000:3.0:1789778295.564218:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778295.564416:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296009472 00000100:00100000:1.0:1789778295.564421:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296009472 00000100:00100000:1.0:1789778295.564463:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 287 00000100:00100000:1.0:1789778295.564472:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718296009472:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778295.564502:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea01bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718296009472:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 32us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778295.564509:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 287 00000100:00100000:2.0:1789778295.564691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296009728 00000100:00100000:2.0:1789778295.564696:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296009728 00000100:00100000:2.0:1789778295.564759:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:2.0:1789778295.564767:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718296009728:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778295.564811:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2373:x1876718296009728:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 45us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778295.564828:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00080000:3.0:1789778295.565407:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778295.623718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.623839:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296009984 00000100:00100000:3.0:1789778295.623850:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296009984 00000100:00100000:3.0:1789778295.623966:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1789778295.623977:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10444:x1876718296009984:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778295.624004:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778295.624025:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7bfa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778295.624159:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789778295.624275:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bfa expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.624290:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:3.0:1789778295.624293:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789778295.624298:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574411d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bfa expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.624311:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44dc00, rc 0) 00000100:00100000:3.0:1789778295.624382:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:10444:x1876718296009984:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 406us (672us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789778295.624403:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:2.0:1789778295.626533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.626651:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296010112 00000100:00100000:3.0:1789778295.626661:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296010112 00000100:00100000:3.0:1789778295.626712:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:3.0:1789778295.626722:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:10444:x1876718296010112:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1789778295.626791:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626818:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626830:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626845:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626852:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626859:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626940:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626950:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.626957:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778295.627009:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627021:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627028:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627035:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627041:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.627045:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627052:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627085:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778295.627088:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.627093:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627099:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c11574411e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627111:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627116:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627127:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627648:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.627652:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627659:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627668:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5900) 00010000:00010000:3.0:1789778295.627671:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.627674:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627680:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574411e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627697:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627704:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627710:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627715:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.627718:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627736:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627743:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.627746:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.627749:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.627753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574411ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778295.627850:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:10444:x1876718296010112:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1127us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778295.627859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1789778295.629841:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.630033:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296010368 00000100:00100000:3.0:1789778295.630044:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296010368 00000100:00100000:3.0:1789778295.630295:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1789778295.630307:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:10444:x1876718296010368:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778295.630606:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:10444:x1876718296010368:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 301us (773us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789778295.630614:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1789778295.678763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.678863:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296010624 00000100:00100000:0.0:1789778295.678873:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296010624 00000100:00100000:0.0:1789778295.678929:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1789778295.678940:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:10447:x1876718296010624:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778295.678967:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778295.678985:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574411f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c01 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679046:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679057:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679092:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679107:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679114:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679120:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679235:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744120b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679244:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744120b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679269:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744120b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778295.679277:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789778295.679353:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679358:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679362:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679365:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778295.679369:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679374:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679382:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778295.679384:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778295.679387:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679390:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574411fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679399:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679403:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679411:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679414:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778295.679416:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679419:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679424:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3ea4c7a100) 00010000:00010000:0.0:1789778295.679425:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778295.679426:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679429:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679467:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574411f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c01 expref: 52 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679493:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744120b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c01 expref: 51 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.679501:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:0.0:1789778295.679503:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778295.679505:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757e00, rc 0) 00000100:00100000:0.0:1789778295.679570:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:10447:x1876718296010624:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 632us (816us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789778295.679587:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:2.0:1789778295.688221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.688308:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296010752 00000100:00100000:3.0:1789778295.688318:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296010752 00000100:00100000:3.0:1789778295.688466:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:3.0:1789778295.688487:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:10447:x1876718296010752:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1789778295.688557:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688592:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688605:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688633:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688641:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688648:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688654:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.688659:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688667:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688679:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.688682:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789778295.688686:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.688692:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441219 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778295.688768:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:10447:x1876718296010752:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 293us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778295.688781:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1789778295.692378:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.692594:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296010880 00000100:00100000:0.0:1789778295.692605:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296010880 00000100:00100000:0.0:1789778295.692674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:0.0:1789778295.692686:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:2373:x1876718296010880:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778295.692701:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778295.692727:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744120b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c01 expref: 51 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.692746:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:0.0:1789778295.692750:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778295.692818:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:2373:x1876718296010880:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 135us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778295.692825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1789778295.694429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.694469:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296011136 00000100:00100000:0.0:1789778295.694532:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296011136 00000100:00100000:0.0:1789778295.694631:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:0.0:1789778295.694643:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:10447:x1876718296011136:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1789778295.694899:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:10447:x1876718296011136:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 257us (475us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789778295.694907:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000001:00080000:3.0:1789778295.781502:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:3.0:1789778295.781529:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789778295.781552:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3e9097de40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789778295.781557:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e9576e900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3e9097d6c0 00000020:00080000:3.0:1789778295.781561:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e9576ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3eb9526800 00000020:00080000:1.0:1789778295.781718:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789778295.781853:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789778295.782101:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314912512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789778295.782184:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778295.782404:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314912512 00000100:00100000:0.0:1789778295.782413:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314912512 00000100:00100000:0.0:1789778295.782467:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789778295.782486:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314912512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789778295.782527:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1789778295.782563:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aadd975, atime: 0x6aadd976, ctime: 0x6aadd975, blocks: 0xb 00010000:00010000:0.0:1789778295.782571:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.782589:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1789778295.782594:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778295.782600:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.782615:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.782625:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.782633:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.782653:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789778295.783602:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1876718314912512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1121us (1412us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789778295.783612:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789778295.783645:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778295.783653:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.783676:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778295.783681:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.783691:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.783709:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.783716:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d09aefd/0x5a1e1c1157441220 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.783734:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778295.783735:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778295.783737:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789778295.783771:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec1441880/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789778295.783777:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314912512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789778295.865646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.865760:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296011392 00000100:00100000:3.0:1789778295.865844:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296011392 00000100:00100000:3.0:1789778295.865971:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:3.0:1789778295.865984:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:10465:x1876718296011392:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1789778295.866014:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778295.866037:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c08 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.866256:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744122e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.866274:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744122e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.866285:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744122e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778295.866297:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789778295.866548:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c08 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.866748:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744122e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c08 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.866852:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.866856:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789778295.866860:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d600, rc 0) 00000100:00100000:3.0:1789778295.866990:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10465:x1876718296011392:12345-192.168.201.45@tcp:101:cat.0 Request processed in 1008us (1353us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789778295.866998:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1789778295.896157:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.896334:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296011520 00000100:00100000:0.0:1789778295.896345:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296011520 00000100:00100000:0.0:1789778295.896416:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:0.0:1789778295.896426:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10466:x1876718296011520:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778295.896459:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778295.896480:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744123c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c0f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.896737:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.896752:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.896765:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778295.896826:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789778295.896830:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778295.896850:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.896879:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744123c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c0f expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.896900:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c0f expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.896909:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778295.896912:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778295.896916:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757800, rc 0) 00000100:00100000:0.0:1789778295.896988:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10466:x1876718296011520:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 563us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778295.896995:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:2.0:1789778295.909920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.910243:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296011904 00000100:00100000:3.0:1789778295.910255:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296011904 00000100:00100000:3.0:1789778295.910316:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1789778295.910328:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10466:x1876718296011904:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778295.911028:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10466:x1876718296011904:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 699us (1117us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789778295.911037:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1789778295.915968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.916244:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296012032 00000100:00100000:3.0:1789778295.916257:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296012032 00000100:00100000:3.0:1789778295.916331:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1789778295.916342:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10466:x1876718296012032:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:3.0:1789778295.916358:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789778295.916385:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574411cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bf3 expref: 15 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.916408:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744122e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c08 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.916420:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574410d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7bb4 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.916453:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.916465:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778295.916530:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:10466:x1876718296012032:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 189us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778295.916537:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1789778295.934233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778295.934341:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296012160 00000100:00100000:0.0:1789778295.934352:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296012160 00000100:00100000:0.0:1789778295.934430:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1789778295.934452:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:10466:x1876718296012160:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:0.0:1789778295.934597:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.934616:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778295.934628:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789778295.938406:0:8093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778295.938845:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789778295.938917:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789778295.939185:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:10466:x1876718296012160:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 4731us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778295.939197:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:2.0:1789778295.977038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778295.977188:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296012288 00000100:00100000:3.0:1789778295.977200:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296012288 00000100:00100000:3.0:1789778295.977258:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:3.0:1789778295.977269:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:10468:x1876718296012288:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778295.977292:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778295.977316:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c16 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977392:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977409:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977422:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977436:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977443:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977473:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977731:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977740:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.977748:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778295.978685:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789778295.978693:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789778295.978719:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.978732:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.978742:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.978748:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.978756:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.978762:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.978767:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979097:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979113:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778295.979116:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.979121:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979127:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979144:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979150:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979156:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979162:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778295.979164:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979169:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979176:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778295.979179:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778295.979182:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979199:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744125f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979243:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979256:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778295.979263:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:3.0:1789778295.979265:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789778295.979268:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d000, rc 0) 00000100:00100000:3.0:1789778295.979340:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10468:x1876718296012288:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 2072us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778295.979349:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00010000:00010000:2.0:1789778296.497876:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789778296.712139:0:12000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778296.712148:0:12000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778296.712180:0:12000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789778296.712185:0:12000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789778296.836269:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789778296.836278:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789778296.836343:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789778296.836350:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789778296.836510:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314912640:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789778296.836609:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778296.848122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778296.848277:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296012416 00000100:00100000:3.0:1789778296.848287:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296012416 00000100:00100000:3.0:1789778296.848345:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1789778296.848355:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296012416:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789778296.848438:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296012416:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778296.848447:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:0.0:1789778296.851056:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314912640:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789778296.856588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778296.857157:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296012544 00000100:00100000:3.0:1789778296.857169:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296012544 00000100:00100000:3.0:1789778296.857251:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1789778296.857262:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296012544:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789778296.857307:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789778296.857442:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296012544:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 181us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778296.857451:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1789778296.861806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778296.861927:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296012672 00000100:00100000:0.0:1789778296.861937:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296012672 00000100:00100000:0.0:1789778296.862030:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:0.0:1789778296.862039:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296012672:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789778296.862147:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862169:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862190:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862263:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862271:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862292:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862319:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862327:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862333:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778296.862373:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789778296.862378:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778296.862392:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862403:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862409:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862415:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862420:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778296.862424:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862431:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862451:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:0.0:1789778296.862454:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778296.862459:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862465:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c115744126d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862477:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862483:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862500:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862505:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778296.862508:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862513:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862521:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b3ea4c7a100) 00010000:00010000:0.0:1789778296.862523:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778296.862525:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862530:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441274 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862556:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862561:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862566:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862570:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778296.862574:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862579:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862586:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:0.0:1789778296.862588:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778296.862590:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778296.862594:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c115744127b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778296.862663:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296012672:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 624us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778296.862672:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1789778296.868798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778296.877333:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296012928 00000100:00100000:1.0:1789778296.877352:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296012928 00000100:00100000:1.0:1789778296.877428:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:1.0:1789778296.877439:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296012928:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778296.877460:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778296.877481:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441282 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c1d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877578:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877603:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877615:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778296.877627:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789778296.877728:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877736:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877743:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877748:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778296.877752:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877759:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877783:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:1.0:1789778296.877786:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778296.877791:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877797:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877838:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441282 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c1d expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877856:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:1.0:1789778296.877859:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789778296.877862:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441282 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c1d expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.877872:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321e00, rc 0) 00000100:00100000:1.0:1789778296.877949:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296012928:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 511us (9174us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789778296.877958:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:0.0:1789778296.884200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778296.884346:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296013056 00000100:00100000:2.0:1789778296.884360:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296013056 00000100:00100000:2.0:1789778296.884425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:2.0:1789778296.884435:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296013056:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789778296.884475:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789778296.884612:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296013056:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 178us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778296.884626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:2.0:1789778296.892579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778296.892653:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296013312 00000100:00100000:1.0:1789778296.892664:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296013312 00000100:00100000:1.0:1789778296.892732:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:1.0:1789778296.892743:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296013312:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778296.892764:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778296.892767:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789778296.892804:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c0f expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.892821:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:1.0:1789778296.892826:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778296.892840:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441297 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c24 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789778296.893636:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789778296.893917:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c115744129e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.893938:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c115744129e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.893950:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c115744129e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.894016:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441297 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c24 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.894033:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c115744129e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c24 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.894042:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87800) 00010000:00010000:1.0:1789778296.894045:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778296.894048:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321c00, rc 0) 00000100:00100000:1.0:1789778296.894316:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10481:x1876718296013312:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1573us (1744us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789778296.894326:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:2.0:1789778296.904578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778296.904642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296013568 00000100:00100000:3.0:1789778296.904653:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296013568 00000100:00100000:3.0:1789778296.908017:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:3.0:1789778296.908038:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10481:x1876718296013568:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789778296.908119:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778296.908149:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c115744129e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c24 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908167:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87800) 00010000:00010000:3.0:1789778296.908179:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778296.908204:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908217:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908227:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908241:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908248:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908262:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908479:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908487:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908494:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908500:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778296.908505:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908513:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908523:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778296.908526:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778296.908530:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908537:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c11574412ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908547:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908554:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908566:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908572:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778296.908575:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908583:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908590:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf162452 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778296.908593:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778296.908596:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.908602:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf162452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778296.908689:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296013568:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 657us (4120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789778296.908697:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:0.0:1789778296.924610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778296.925321:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296013696 00000100:00100000:1.0:1789778296.925331:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296013696 00000100:00100000:1.0:1789778296.925382:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:1.0:1789778296.925394:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296013696:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778296.925417:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778296.925441:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c2b expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.925476:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.925494:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.925504:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.925583:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 16 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.925595:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 15 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.925601:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:1.0:1789778296.925603:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789778296.925606:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320600, rc 0) 00000100:00100000:1.0:1789778296.925668:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10481:x1876718296013696:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 277us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778296.925675:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:0.0:1789778296.931967:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778296.933001:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296013952 00000100:00100000:1.0:1789778296.933014:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296013952 00000100:00100000:1.0:1789778296.933107:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:1.0:1789778296.933120:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10481:x1876718296013952:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789778296.933219:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.933389:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778296.933414:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789778296.933729:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789778296.933740:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351891673828ns, next at 352891671512ns, rc = 0 00000004:00010000:1.0:1789778296.934106:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037e7ecb4 reply state 00000000c0d95aed transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778296.934117:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789778296.934853:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:10481:x1876718296013952:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1730us (2893us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789778296.934864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00010000:00010000:2.0:1789778296.943530:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778296.943538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:2.0:1789778296.943547:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778296.943556:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778296.943563:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778296.943568:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778296.943576:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778296.943596:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:2.0:1789778296.943600:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789778296.943605:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778296.943612:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574412c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778296.943692:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296014080 00000100:00100000:3.0:1789778296.943704:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296014080 00000100:00100000:3.0:1789778296.943762:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:3.0:1789778296.943783:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:10481:x1876718296014080:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778296.943812:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778296.943836:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c32 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.943932:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.943949:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778296.943970:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:3.0:1789778296.943973:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789778296.943976:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d800, rc 0) 00000100:00100000:3.0:1789778296.944228:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:10481:x1876718296014080:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 455us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778296.944236:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:0.0:1789778296.948999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778296.949166:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296014208 00000100:00100000:2.0:1789778296.951114:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296014208 00000100:00100000:2.0:1789778296.951536:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:2.0:1789778296.951547:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1876718296014208:12345-192.168.201.45@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789778296.951589:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:2.0:1789778296.951620:0:6694:0:(genops.c:1385:class_connect()) connect: client bdd103b9-ae1a-4bf0-9cc3-bcece875c39a, cookie 0x5a1e1c11574412d6 00002000:00100000:2.0:1789778296.951633:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bdd103b9-ae1a-4bf0-9cc3-bcece875c39a/ffff9b3e88afb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789778296.951646:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789778296.951926:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789778296.951963:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b3e88af9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778296.952048:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2371:x1876718296014208:12345-192.168.201.45@tcp:8:lhsmtool_posix.0 Request processed in 501us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778296.952056:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:0.0:1789778296.954505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778296.954628:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296014336 00000100:00100000:3.0:1789778296.954639:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296014336 00000100:00080000:2.0:1789778296.954695:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778296.954758:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:3.0:1789778296.954783:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:0:x1876718296014336:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000001:00100000:2.0:1789778296.998562:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000001:00080000:2.0:1789778296.998754:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1789778296.998942:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:0:x1876718296014336:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 44168us (44441us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789778296.998954:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1789778297.002725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778297.002942:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296014592 00000100:00100000:3.0:1789778297.002953:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296014592 00000100:00100000:3.0:1789778297.003635:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1789778297.003646:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:10481:x1876718296014592:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789778297.004583:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:10481:x1876718296014592:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 934us (1861us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789778297.004592:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00080000:2.0:1789778297.004694:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778297.008710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778297.008838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296014848 00000100:00100000:3.0:1789778297.008861:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296014848 00000100:00100000:3.0:1789778297.008958:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:3.0:1789778297.008970:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:10481:x1876718296014848:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789778297.009117:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:10481:x1876718296014848:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 149us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778297.009125:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:0.0:1789778297.016386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778297.016626:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296014976 00000100:00100000:2.0:1789778297.016638:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296014976 00000100:00100000:2.0:1789778297.016699:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:2.0:1789778297.016710:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:10481:x1876718296014976:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778297.016734:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778297.016755:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574412dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c39 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.016846:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574412e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.016861:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574412e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.016890:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574412e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778297.016932:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778297.016956:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574412e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.016984:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574412dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c39 expref: 20 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.017004:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574412e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c39 expref: 19 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.017012:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:2.0:1789778297.017016:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789778297.017020:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8e00, rc 0) 00000100:00100000:2.0:1789778297.017590:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10481:x1876718296014976:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 879us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778297.017599:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:2.0:1789778297.023755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778297.023888:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296015104 00000100:00100000:0.0:1789778297.023898:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296015104 00000100:00100000:0.0:1789778297.023997:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:0.0:1789778297.024008:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718296015104:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778297.024029:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778297.024055:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c40 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789778297.024144:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd979, blocks: 0x1 00010000:00010000:0.0:1789778297.024163:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1789778297.024167:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778297.024188:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.024384:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.024399:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756600, rc 0) 00000100:00100000:0.0:1789778297.024492:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718296015104:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 485us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778297.024499:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:0.0:1789778297.026851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.026956:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296015360 00000100:00100000:1.0:1789778297.026968:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296015360 00000100:00100000:1.0:1789778297.027026:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1789778297.027038:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10481:x1876718296015360:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789778297.027549:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10481:x1876718296015360:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 511us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778297.027557:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1789778297.033042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778297.033337:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296015488 00000100:00100000:2.0:1789778297.033348:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296015488 00000100:00100000:2.0:1789778297.033409:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1789778297.033431:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:10481:x1876718296015488:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778297.033450:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778297.033471:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c47 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.033527:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.033536:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778297.033540:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778297.033546:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.033582:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.033596:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778297.033611:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb9530000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314912768:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778297.033811:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9747c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778297.036378:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb9530000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314912768:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778297.036589:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.036613:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8a00, rc 0) 00000100:00100000:1.0:1789778297.036725:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:10481:x1876718296015488:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3306us (3692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778297.036748:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1789778297.047904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.047982:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296015616 00000100:00100000:1.0:1789778297.047994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296015616 00010000:00010000:1.0:1789778297.048037:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.048123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1789778297.048133:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88caf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296015616:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778297.048147:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778297.048179:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.048194:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.048329:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574412eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c40 expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.048350:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789778297.048355:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778297.048366:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.048378:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.048557:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.048574:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1876718314912896:192.168.201.45@tcp:105: 00000100:00100000:1.0:1789778297.048657:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627840 going to sleep for 11 seconds 00000100:00100000:2.0:1789778297.052577:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1876718314912896:192.168.201.45@tcp:105: 00010000:00010000:2.0:1789778297.052609:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778297.052682:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88caf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718296015616:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 4548us (4789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778297.052695:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1789778297.053925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778297.054102:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296015744 00000100:00100000:2.0:1789778297.054111:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296015744 00002000:00100000:2.0:1789778297.054159:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b3eb5857b80 x1876718296015744/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:223/0 lens 504/0 e 0 to 0 dl 1789778308 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789778297.054212:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3eb5857b80 with x1876718296015744 ext(0->8) 00002000:00010000:2.0:1789778297.054218:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3eb5857b80 00000100:00100000:2.0:1789778297.054243:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1789778297.054252:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718296015744:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789778297.054924:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296015744:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 670us (1003us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789778297.054933:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00002000:00100000:2.0:1789778297.054940:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b3eb5857b80 x1876718296015744/t4294967302(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:223/0 lens 504/448 e 0 to 0 dl 1789778308 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789778297.054948:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3eb5857b80 with x1876718296015744 ext(0->8) 00002000:00010000:2.0:1789778297.054951:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3eb5857b80 00000100:00100000:3.0:1789778297.058544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.058706:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296015872 00000100:00100000:1.0:1789778297.058717:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296015872 00000100:00100000:1.0:1789778297.058791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:1.0:1789778297.058801:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10481:x1876718296015872:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789778297.105246:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1789778297.105260:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789778297.105277:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1789778297.105286:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:0.0:1789778297.105638:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296015872:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 46831us (47100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778297.105648:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00000020:00080000:0.0:1789778297.107368:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789778297.107385:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789778297.107613:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314913024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789778297.107681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778297.107885:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314913024 00000100:00100000:1.0:1789778297.107893:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314913024 00000100:00100000:1.0:1789778297.107961:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789778297.107972:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314913024:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789778297.108204:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789778297.108566:0:8205:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789778297.108571:0:8205:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789778297 00002000:00010000:1.0:1789778297.108574:0:8205:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789778297.108576:0:8205:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789778297 -> 1789778297 00002000:00010000:1.0:1789778297.108578:0:8205:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789778297.108637:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314913024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 666us (954us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789778297.108645:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1789778297.109326:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3eb98e1f80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789778297.109335:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314913024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789778297.111778:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778297.111894:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296016000 00000100:00100000:3.0:1789778297.111906:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296016000 00000100:00100000:3.0:1789778297.112020:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:3.0:1789778297.112030:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2372:x1876718296016000:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789778297.164617:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2372:x1876718296016000:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 52578us (53192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778297.164631:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000001:00080000:2.0:1789778297.164885:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789778297.164907:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789778297.169863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778297.171715:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296016256 00000100:00100000:2.0:1789778297.171730:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296016256 00000100:00100000:3.0:1789778297.173128:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:3.0:1789778297.173142:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296016256:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789778297.173217:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778297.173257:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574412e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c39 expref: 13 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.173280:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:3.0:1789778297.173285:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778297.173316:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.173329:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.173340:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778297.173619:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fac7beeb reply state 0000000038b35b90 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778297.173629:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778297.173726:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10481:x1876718296016256:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 586us (3874us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789778297.173733:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00010000:00010000:3.0:1789778297.176026:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.176043:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.176100:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.176106:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778297.176111:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.176119:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.176136:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:3.0:1789778297.176140:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778297.176144:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.176151:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c11574412f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778297.178150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778297.178760:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296016384 00000100:00100000:0.0:1789778297.178780:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296016384 00000100:00100000:0.0:1789778297.178882:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:0.0:1789778297.178895:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296016384:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789778297.179613:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789778297.179618:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789778297 -> 1789778295 00002000:00010000:0.0:1789778297.179621:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789778294 00002000:00010000:0.0:1789778297.179623:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789778297 -> 1789778295 00002000:00010000:0.0:1789778297.179624:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789778297.179732:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296016384:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 838us (1668us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789778297.179740:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:1.0:1789778297.182921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778297.183039:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296016640 00000100:00100000:2.0:1789778297.183049:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296016640 00000100:00100000:2.0:1789778297.187977:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:2.0:1789778297.187997:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10481:x1876718296016640:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789778297.188098:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.188115:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 13 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.188145:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.188350:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 13 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.188366:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 13 pid: 8093 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778297.188380:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb9531180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314913152:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778297.188596:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9747000 going to sleep for 11 seconds 00000100:00100000:1.0:1789778297.191583:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb9531180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314913152:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778297.191612:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.192785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778297.192954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296016768 00000100:00100000:0.0:1789778297.192963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296016768 00010000:00010000:0.0:1789778297.192999:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 14 pid: 8093 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778297.193048:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:0.0:1789778297.193056:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2374:x1876718296016768:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778297.193105:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778297.193112:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 14 pid: 8093 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.193124:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 14 pid: 8093 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.193147:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574412c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c2b expref: 14 pid: 8093 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.193161:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:0.0:1789778297.193175:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.193185:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.193199:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.193218:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778297.193270:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:2374:x1876718296016768:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 213us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778297.193277:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00010000:00010000:1.0:1789778297.193506:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193515:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193542:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193548:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193555:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193561:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778297.193565:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193573:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193582:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:1.0:1789778297.193585:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789778297.193589:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.193595:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441300 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.193646:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:10481:x1876718296016640:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 5657us (10736us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789778297.193653:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:2.0:1789778297.197984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.198097:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296016896 00000100:00100000:1.0:1789778297.198108:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296016896 00000100:00100000:1.0:1789778297.198179:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:1.0:1789778297.198198:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296016896:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789778297.198243:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.198264:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.198273:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778297.198278:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789778297.198283:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.198322:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.198336:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 7 pid: 6691 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.198351:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314913280:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778297.198440:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778297.203484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.203589:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314913280:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778297.203618:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778297.207626:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296017024 00000100:00100000:0.0:1789778297.207659:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296017024 00010000:00010000:0.0:1789778297.207710:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 8 pid: 6691 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778297.208138:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:0.0:1789778297.208150:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296017024:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778297.208173:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778297.208563:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 8 pid: 6691 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.208579:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 8 pid: 6691 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.208602:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c11574412f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c47 expref: 8 pid: 6691 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.208618:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778297.208622:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778297.208627:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.208637:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.208720:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778297.208805:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296017024:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 657us (5328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778297.208828:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00010000:00010000:1.0:1789778297.211618:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211638:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211681:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211690:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211699:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211706:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778297.211711:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211720:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211764:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.211785:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157441307 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.211903:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718296016896:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 13710us (13926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778297.211915:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:2.0:1789778297.219445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.219637:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296017280 00000100:00100000:1.0:1789778297.219648:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296017280 00000100:00100000:1.0:1789778297.219762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:1.0:1789778297.219782:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:10481:x1876718296017280:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789778297.219865:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.219882:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.219894:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.220137:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.220148:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.220186:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.220340:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.220353:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 13 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.220366:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314913408:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778297.221577:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778297.227744:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314913408:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778297.227788:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778297.244377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778297.244754:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296017408 00000100:00100000:3.0:1789778297.244765:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296017408 00010000:00010000:3.0:1789778297.244822:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 14 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778297.244915:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:3.0:1789778297.244925:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2375:x1876718296017408:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778297.244942:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778297.244950:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 14 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.244986:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 14 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.245012:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c11574412cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c32 expref: 14 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.245031:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:3.0:1789778297.245036:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.245047:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.245056:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778297.245137:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778297.245207:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:2375:x1876718296017408:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 283us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778297.245216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00010000:00010000:1.0:1789778297.245281:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.245289:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789778297.245556:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789778297.245700:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789778297.245744:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789778297.245832:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876718314913536:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789778297.245888:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778297.245923:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627840 going to sleep for 11 seconds 00000100:00100000:1.0:1789778297.245959:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314913536 00000100:00100000:1.0:1789778297.245965:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314913536 00000100:00100000:1.0:1789778297.245999:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778297.246007:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1876718314913536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789778297.246108:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1876718314913536:12345-0@lo:1000:mdt00_000.0 Request processed in 101us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778297.246116:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778297.246149:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789778297.246154:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3eb98e1f80, transno 4294967303 00000100:00100000:1.0:1789778297.246167:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876718314913536:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789778297.246608:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789778297.246661:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876718314913664:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789778297.246692:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778297.246710:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e95627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778297.246903:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314913664 00000100:00100000:1.0:1789778297.246908:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314913664 00000100:00100000:1.0:1789778297.246933:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778297.246940:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1876718314913664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789778297.247138:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1876718314913664:12345-0@lo:1000:mdt00_000.0 Request processed in 196us (444us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789778297.247146:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778297.247181:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1876718314913664:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789778297.247212:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247221:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247240:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247246:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778297.247250:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247258:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247273:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:1.0:1789778297.247275:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778297.247280:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247285:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441315 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247325:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247331:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247336:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247341:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778297.247344:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247359:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247367:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:1.0:1789778297.247369:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778297.247372:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247377:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744124a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247397:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247409:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247417:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247439:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.247454:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 16 pid: 5846 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778297.247465:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314913792:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778297.247518:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778297.259999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.260142:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314913792:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778297.260196:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778297.261631:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296017536 00000100:00100000:0.0:1789778297.261644:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296017536 00010000:00010000:0.0:1789778297.261687:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 17 pid: 5846 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778297.261730:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1789778297.261740:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:2375:x1876718296017536:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778297.261754:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778297.261761:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 17 pid: 5846 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.261785:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 17 pid: 5846 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.261810:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d000/0x5a1e1c1157441266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c16 expref: 17 pid: 5846 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.261826:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:0.0:1789778297.261954:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.261964:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.261971:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778297.262013:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778297.262212:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262221:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262233:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262239:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262245:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262250:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778297.262254:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262262:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262271:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:1.0:1789778297.262274:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778297.262278:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262283:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c115744131c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262307:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262313:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262319:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262325:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778297.262328:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262333:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262341:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:1.0:1789778297.262344:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789778297.262346:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.262353:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744130e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789778297.263141:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778297.263148:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778297.263200:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789778297.263206:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789778297.263805:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:2375:x1876718296017536:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2059us (3810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778297.263818:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:1.0:1789778297.265121:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10481:x1876718296017280:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 45332us (45679us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789778297.265133:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000020:00080000:1.0:1789778297.265140:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789778297.268629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778297.268710:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296017792 00000100:00100000:1.0:1789778297.268720:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296017792 00000100:00100000:1.0:1789778297.268796:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1789778297.268804:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10481:x1876718296017792:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789778297.269840:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789778297.269972:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789778297.270026:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.270042:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.270053:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.270061:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.270100:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.270107:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778297.270124:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778297.270347:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778297.270355:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.270362:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778297.270367:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.270376:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.270399:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:2.0:1789778297.270402:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789778297.270407:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.270423:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441323 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778297.270441:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778297.270443:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778297.270444:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778297.270722:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:10481:x1876718296017792:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 1914us (2096us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789778297.270732:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000020:00080000:1.0:1789778297.270739:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789778297.521867:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789778298.291118:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778298.291128:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778298.291160:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789778298.291167:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789778298.545614:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789778298.563588:0:12054:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778298.563597:0:12054:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778298.563634:0:12054:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789778298.563641:0:12054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789778298.725414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778298.725593:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296018048 00000100:00100000:1.0:1789778298.725603:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296018048 00000100:00100000:1.0:1789778298.725669:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:1.0:1789778298.725680:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:10498:x1876718296018048:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778298.725728:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778298.725760:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744132a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c4e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.725874:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441331 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.725889:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.725901:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778298.725912:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789778298.726038:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744132a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c4e expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.726055:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c4e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.726094:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:1.0:1789778298.726098:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789778298.726102:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320200, rc 0) 00000100:00100000:1.0:1789778298.726180:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10498:x1876718296018048:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 502us (780us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789778298.726188:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:2.0:1789778298.736026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778298.736371:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296018176 00000100:00100000:3.0:1789778298.736380:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296018176 00000100:00100000:3.0:1789778298.736433:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:3.0:1789778298.736442:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10498:x1876718296018176:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:3.0:1789778298.736511:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736535:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736547:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736652:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736660:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736667:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736941:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736950:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.736957:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778298.736994:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737006:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737012:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737028:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737034:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778298.737038:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737045:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737056:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778298.737059:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778298.737102:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737110:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c115744133f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737121:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737127:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737133:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737138:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778298.737141:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737155:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778298.737165:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778298.737167:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737173:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737188:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737194:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737199:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737204:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778298.737206:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737211:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737218:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5b00) 00010000:00010000:3.0:1789778298.737220:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778298.737223:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.737237:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744134d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778298.737315:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10498:x1876718296018176:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 872us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778298.737324:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:1.0:1789778298.785895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778298.785994:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296018432 00000100:00100000:0.0:1789778298.786007:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296018432 00000100:00100000:0.0:1789778298.786102:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1789778298.786113:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10501:x1876718296018432:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778298.786135:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778298.786156:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441354 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c55 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786231:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786246:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786259:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786277:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786285:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786292:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786594:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786603:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786611:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778298.786620:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789778298.786710:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786717:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786724:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786730:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778298.786734:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786756:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786770:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778298.786773:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778298.786778:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786794:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c115744135b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786808:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786814:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786819:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786824:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778298.786827:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786833:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786841:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3ea4c7a900) 00010000:00010000:0.0:1789778298.786843:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778298.786846:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786852:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786890:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441354 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786904:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.786919:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:0.0:1789778298.786921:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778298.786924:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756600, rc 0) 00000100:00100000:0.0:1789778298.786985:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10501:x1876718296018432:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 874us (1102us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789778298.786992:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:2.0:1789778298.793307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778298.793411:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296018560 00000100:00100000:1.0:1789778298.793424:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296018560 00000100:00100000:1.0:1789778298.793504:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:1.0:1789778298.793514:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10501:x1876718296018560:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1789778298.793597:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793616:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793630:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793659:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793666:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793674:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793690:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778298.793695:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793703:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793715:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:1.0:1789778298.793719:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789778298.793724:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.793751:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778298.793828:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10501:x1876718296018560:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 314us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778298.793836:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:2.0:1789778298.796166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778298.796366:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296018816 00000100:00100000:1.0:1789778298.796377:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296018816 00000100:00100000:1.0:1789778298.796424:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1789778298.796432:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e867b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10501:x1876718296018816:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1789778298.796791:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e867b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:10501:x1876718296018816:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 357us (632us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789778298.796799:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1789778298.840261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778298.840361:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296019072 00000100:00100000:3.0:1789778298.840372:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296019072 00000100:00100000:3.0:1789778298.840437:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:3.0:1789778298.840448:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:10022:x1876718296019072:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1789778298.840644:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778298.840667:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744137e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c5c expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.840798:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.840813:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.840821:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.840859:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.840873:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 23 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778298.840908:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1789180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314913920:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778298.841012:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777540 going to sleep for 11 seconds 00000100:00100000:3.0:1789778298.844012:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1789180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314913920:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778298.844046:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778298.848890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778298.849004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296019200 00000100:00100000:3.0:1789778298.849017:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296019200 00010000:00010000:3.0:1789778298.849085:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 24 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778298.849160:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:3.0:1789778298.849170:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:2375:x1876718296019200:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778298.849185:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778298.849193:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 24 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.849206:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 24 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.849228:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c55 expref: 24 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.849247:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:3.0:1789778298.849253:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.849274:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.849283:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.849321:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778298.849451:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.849467:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778298.849487:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789778298.849654:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c115744137e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 25 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.849669:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 24 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.849676:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:1.0:1789778298.849693:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789778298.849696:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c600, rc 0) 00000100:00100000:3.0:1789778298.849831:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:2375:x1876718296019200:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 661us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778298.849839:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:1.0:1789778298.853054:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:10022:x1876718296019072:12345-192.168.201.45@tcp:101:bash.0 Request processed in 12581us (12777us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789778298.853084:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:2.0:1789778298.869927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778298.870306:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296019456 00000100:00100000:3.0:1789778298.870317:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296019456 00000100:00100000:3.0:1789778298.870381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:3.0:1789778298.870392:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:10022:x1876718296019456:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:3.0:1789778298.870845:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.870867:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778298.870879:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778298.870932:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1789778298.870957:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006401b073 reply state 00000000d50a3fca transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778298.870966:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789778298.873850:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789778298.874196:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10022:x1876718296019456:12345-192.168.201.45@tcp:36:bash.0 Request processed in 3800us (4274us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789778298.874219:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000020:00080000:2.0:1789778298.874225:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789778298.887396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778298.889182:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296019584 00000100:00100000:1.0:1789778298.889199:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296019584 00000100:00100000:1.0:1789778298.889277:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:1.0:1789778298.889288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10022:x1876718296019584:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1789778298.889315:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778298.889336:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744139a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.889400:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744139a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c63 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.889416:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744139a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c63 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778298.889438:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:1.0:1789778298.889442:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778298.889446:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320600, rc 0) 00000100:00100000:1.0:1789778298.889519:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:10022:x1876718296019584:12345-192.168.201.45@tcp:101:bash.0 Request processed in 233us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778298.889527:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00010000:00010000:0.0:1789778298.891217:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.891233:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.891241:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.891248:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778298.891252:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.891260:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.891275:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:0.0:1789778298.891278:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778298.891282:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778298.891287:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d800/0x5a1e1c1157441393 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778298.897677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778298.897832:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296019712 00000100:00100000:2.0:1789778298.897846:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296019712 00000100:00100000:2.0:1789778298.897971:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:2.0:1789778298.897981:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:10022:x1876718296019712:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778298.898000:0:8205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778298.898020:0:8205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c6a expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778298.898057:0:8205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aadd977, atime: 0x6aadd976, ctime: 0x6aadd977, blocks: 0xb 00010000:00010000:2.0:1789778298.898109:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1789778298.898115:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778298.898123:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 7 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778298.898144:0:8205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 7 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778298.898157:0:8205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9600, rc 0) 00000100:00100000:2.0:1789778298.898213:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:10022:x1876718296019712:12345-192.168.201.45@tcp:101:bash.0 Request processed in 234us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778298.898221:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00080000:3.0:1789778298.903329:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778298.906241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778298.906480:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296019840 00000100:00100000:3.0:1789778298.906502:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296019840 00002000:00010000:3.0:1789778298.906544:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789778298.906748:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec17d8e00 with x1876718296019840 ext(0->18446744073709551615) 00002000:00010000:3.0:1789778298.906760:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec17d8e00. 00000100:00100000:3.0:1789778298.906834:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1789778298.906844:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296019840:12345-192.168.201.45@tcp:10:bash.0 00002000:00010000:3.0:1789778298.907149:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789778298.907153:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789778295 -> 1789778299 00002000:00010000:3.0:1789778298.907156:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789778294 -> 1789778294 00002000:00010000:3.0:1789778298.907158:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789778295 -> 1789778299 00002000:00010000:3.0:1789778298.907161:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789778298.907223:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296019840:12345-192.168.201.45@tcp:10:bash.0 Request processed in 380us (994us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789778298.907232:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00002000:00010000:3.0:1789778298.907236:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789778298.907239:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec17d8e00 with x1876718296019840 ext(0->18446744073709551615) 00002000:00010000:3.0:1789778298.907244:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec17d8e00. 00000100:00100000:1.0:1789778299.002941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.003052:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296019968 00000100:00100000:2.0:1789778299.003106:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296019968 00000100:00100000:2.0:1789778299.003174:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:2.0:1789778299.003186:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10515:x1876718296019968:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1789778299.003255:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003273:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003285:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003299:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003305:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003312:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003540:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789778299.003643:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789778299.003780:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003789:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778299.003828:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003851:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003857:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003864:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003870:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.003874:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003881:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003893:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778299.003896:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.003900:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003906:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574413a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003918:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003925:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003930:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003941:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.003944:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003949:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003957:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e922c1b00) 00010000:00010000:2.0:1789778299.003960:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.003962:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003968:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003983:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003988:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003994:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.003998:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.004001:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.004007:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.004026:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:2.0:1789778299.004028:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.004043:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.004048:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.004176:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10515:x1876718296019968:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 990us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.004184:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 91 00000100:00100000:1.0:1789778299.044426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778299.044666:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296020224 00000100:00100000:0.0:1789778299.044688:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296020224 00000100:00100000:0.0:1789778299.044771:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:0.0:1789778299.044781:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10518:x1876718296020224:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778299.044801:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778299.044820:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574413bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c71 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.044893:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.044908:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.044921:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.044936:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.044942:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.044947:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045584:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045593:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045601:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778299.045613:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789778299.045714:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045722:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045729:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045744:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.045756:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045764:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045776:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778299.045779:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.045784:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045791:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574413c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045803:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045809:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045815:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045821:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.045824:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045829:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045837:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3ea4c7a900) 00010000:00010000:2.0:1789778299.045839:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.045848:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045854:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574413cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045897:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c11574413bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c71 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045911:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c71 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.045919:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:2.0:1789778299.045921:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789778299.045924:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9400, rc 0) 00000100:00100000:2.0:1789778299.045991:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:10518:x1876718296020224:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1211us (1576us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789778299.045999:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:1.0:1789778299.050002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.050158:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296020352 00000100:00100000:2.0:1789778299.050169:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296020352 00000100:00100000:2.0:1789778299.050227:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:2.0:1789778299.050238:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:10518:x1876718296020352:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1789778299.050303:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.050320:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 29 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.050330:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.050379:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 29 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.050404:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 29 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.050418:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314914048:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778299.050506:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9747180 going to sleep for 11 seconds 00000100:00100000:2.0:1789778299.063880:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314914048:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778299.063912:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.065508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.065655:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296020608 00000100:00100000:3.0:1789778299.065663:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296020608 00000100:00100000:3.0:1789778299.065729:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:3.0:1789778299.065750:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:5627:x1876718296020608:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789778299.066264:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:5627:x1876718296020608:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 515us (760us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789778299.066273:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1789778299.068508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778299.068591:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296020736 00000100:00100000:0.0:1789778299.068601:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296020736 00010000:00010000:0.0:1789778299.068653:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 31 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778299.068702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:0.0:1789778299.068712:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:2374:x1876718296020736:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778299.068727:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778299.068744:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 31 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.068759:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 31 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.068782:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441385 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c5c expref: 31 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.068799:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:0.0:1789778299.068805:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.068814:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.068821:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.068855:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778299.068905:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:2374:x1876718296020736:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 195us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778299.068913:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00010000:00010000:1.0:1789778299.069438:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069447:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069477:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069483:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069489:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069494:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778299.069499:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069507:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069515:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:1.0:1789778299.069518:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789778299.069521:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.069526:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574413e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.069589:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:10518:x1876718296020352:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 19353us (19598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.069597:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:1.0:1789778299.073964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.074283:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296020992 00000100:00100000:3.0:1789778299.074293:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296020992 00000100:00100000:3.0:1789778299.074367:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:3.0:1789778299.074377:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:10518:x1876718296020992:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778299.074618:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:10518:x1876718296020992:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 242us (663us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789778299.074627:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1789778299.147179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.147250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778299.147327:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296021120 00000100:00100000:0.0:1789778299.147336:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296021120 00002000:00100000:0.0:1789778299.147375:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9b3ec16d1880 x1876718296021120/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:225/0 lens 496/0 e 0 to 0 dl 1789778310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789778299.147383:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec16d1880 with x1876718296021120 ext(0->7) 00002000:00010000:0.0:1789778299.147387:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec16d1880 00000100:00100000:0.0:1789778299.147414:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1789778299.147421:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296021120:12345-192.168.201.45@tcp:4:bash.0 00000100:00100000:0.0:1789778299.147823:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2375:x1876718296021120:12345-192.168.201.45@tcp:4:bash.0 Request processed in 401us (655us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789778299.147829:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00002000:00100000:0.0:1789778299.147834:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9b3ec16d1880 x1876718296021120/t4294967307(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:225/0 lens 496/448 e 0 to 0 dl 1789778310 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789778299.147840:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec16d1880 with x1876718296021120 ext(0->7) 00002000:00010000:0.0:1789778299.147843:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec16d1880 00000100:00100000:3.0:1789778299.147937:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296021248 00000100:00100000:3.0:1789778299.147941:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296021248 00000100:00100000:3.0:1789778299.147971:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:3.0:1789778299.147976:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2375:x1876718296021248:12345-192.168.201.45@tcp:16:kworker.0 00000100:00100000:0.0:1789778299.165097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.165245:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296021504 00000100:00100000:3.0:1789778299.165255:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296021504 00000100:00100000:3.0:1789778299.165314:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:3.0:1789778299.165325:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:10529:x1876718296021504:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1789778299.165348:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778299.165368:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574413e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c78 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165441:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165457:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165469:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165484:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165512:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165519:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165869:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c11574413fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165879:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c11574413fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165887:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c11574413fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778299.165897:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789778299.165981:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165988:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.165996:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166002:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44cc00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778299.166007:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166014:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166037:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778299.166039:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778299.166044:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166050:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574413ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166105:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166113:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166119:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166125:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44de00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778299.166128:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166238:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166248:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5b00) 00010000:00010000:3.0:1789778299.166250:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778299.166253:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166259:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574413f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166313:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574413e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c78 expref: 33 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166328:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c11574413fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c78 expref: 32 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.166336:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:3.0:1789778299.166338:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778299.166341:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d400, rc 0) 00000100:00100000:3.0:1789778299.166445:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:10529:x1876718296021504:12345-192.168.201.45@tcp:101:cat.0 Request processed in 1121us (1389us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789778299.166453:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:1.0:1789778299.174575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.174621:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296021760 00000100:00100000:1.0:1789778299.174632:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296021760 00000100:00100000:1.0:1789778299.174757:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:1.0:1789778299.174770:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:10529:x1876718296021760:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:1.0:1789778299.174999:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:10529:x1876718296021760:12345-192.168.201.45@tcp:35:cat.0 Request processed in 232us (435us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789778299.175007:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:3.0:1789778299.190317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.190355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296022016 00000100:00100000:3.0:1789778299.190365:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296022016 00000100:00100000:3.0:1789778299.190765:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:3.0:1789778299.190777:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:10530:x1876718296022016:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:3.0:1789778299.190834:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789778299.190860:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c11574413fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c78 expref: 33 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.190885:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574413d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c71 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.190898:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744139a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c63 expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.190925:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:3.0:1789778299.190936:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778299.190956:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.190970:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.190980:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.190995:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.191003:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.191009:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.191525:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.191535:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.191543:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789778299.194000:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789778299.194015:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354151949173ns, next at 355151945669ns, rc = 0 00010000:00010000:3.0:1789778299.194127:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194144:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194154:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194162:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194168:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194174:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194192:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778299.194218:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194224:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194230:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194236:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778299.194241:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194249:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194267:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778299.194270:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789778299.194275:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194281:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441418 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194298:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194304:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194310:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194314:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44cc00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778299.194317:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194322:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194330:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:3.0:1789778299.194333:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778299.194336:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194344:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c115744140a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778299.194364:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c72bd788 reply state 0000000085c2617a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.194373:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778299.194531:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:10530:x1876718296022016:12345-192.168.201.45@tcp:36:rm.0 Request processed in 3752us (4220us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789778299.194540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00010000:00010000:3.0:1789778299.194575:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778299.194582:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194587:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44dc00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778299.194591:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194597:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194606:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b3e82bb5100) 00010000:00010000:3.0:1789778299.194609:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789778299.194612:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194618:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c115744141f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.194630:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778299.194632:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778299.194634:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778299.197164:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.197181:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.197188:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.197193:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778299.197198:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.197206:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.197238:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5600) 00010000:00010000:1.0:1789778299.197241:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778299.197245:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.197252:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c1157441411 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789778299.206490:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1789778299.206518:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1789778299.206886:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296021248:12345-192.168.201.45@tcp:16:kworker.0 Request processed in 58902us (59629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778299.206899:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:3.0:1789778299.247280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.247643:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296022272 00000100:00100000:2.0:1789778299.247655:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296022272 00000100:00100000:2.0:1789778299.247791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:2.0:1789778299.247802:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:10536:x1876718296022272:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778299.247832:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778299.247855:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441426 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c7f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.247984:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.248012:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.248025:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.248202:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.248210:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.248217:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789778299.249014:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789778299.253939:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.253963:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.253975:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254017:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254025:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254041:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254061:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.254085:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254094:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254108:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778299.254111:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.254116:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254123:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744142d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778299.254336:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a5e2afb reply state 000000003cbe070d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.254348:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789778299.254442:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441426 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254458:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.254466:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e922c1b00) 00010000:00010000:2.0:1789778299.254469:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778299.254471:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9e00, rc 0) 00000100:00100000:2.0:1789778299.254604:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:10536:x1876718296022272:12345-192.168.201.45@tcp:101:bash.0 Request processed in 6804us (7336us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789778299.254622:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:0.0:1789778299.258107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.258196:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296022400 00000100:00100000:2.0:1789778299.258206:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296022400 00000100:00100000:2.0:1789778299.258276:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:2.0:1789778299.258287:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718296022400:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778299.258306:0:8205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778299.258327:0:8205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c86 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778299.258354:0:8205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778299.258373:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1789778299.258389:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778299.258398:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 6 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.258420:0:8205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 6 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.258434:0:8205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8e00, rc 0) 00000100:00100000:2.0:1789778299.258488:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296022400:12345-192.168.201.45@tcp:101:bash.0 Request processed in 203us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.258496:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00080000:0.0:1789778299.258647:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789778299.259879:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.259891:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.259898:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.259904:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778299.259908:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.259915:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.259931:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e922c1a00) 00010000:00010000:1.0:1789778299.259934:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778299.259939:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.259945:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441434 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.261001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778299.261103:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296022528 00000100:00100000:0.0:1789778299.261112:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296022528 00000100:00100000:0.0:1789778299.261166:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:0.0:1789778299.261176:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:10536:x1876718296022528:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778299.261203:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778299.261220:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c8d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.261249:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 7 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.261259:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778299.261263:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778299.261269:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.261302:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 7 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.261318:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 7 pid: 8205 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778299.261333:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876718314914176:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778299.261588:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf35ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789778299.263984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.264057:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296022656 00000100:00100000:3.0:1789778299.264095:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296022656 00010000:00010000:3.0:1789778299.264136:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 8 pid: 8205 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.264180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:3.0:1789778299.264190:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296022656:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778299.264205:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778299.264227:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 8 pid: 8205 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.264241:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 8 pid: 8205 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.264265:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778299.264269:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778299.264277:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.264287:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.264323:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.264339:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1876718314914304:192.168.201.45@tcp:105: 00000100:00100000:3.0:1789778299.264445:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777600 going to sleep for 11 seconds 00000100:00100000:3.0:1789778299.266567:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1876718314914304:192.168.201.45@tcp:105: 00010000:00010000:3.0:1789778299.266592:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778299.266648:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296022656:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2459us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778299.266659:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00010000:00010000:0.0:1789778299.267893:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d79d92/0x5a1e1c1157441449 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c86 expref: 7 pid: 8205 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778299.267913:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876718314914176:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778299.267942:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.267970:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757800, rc 0) 00000100:00100000:0.0:1789778299.268147:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:10536:x1876718296022528:12345-192.168.201.45@tcp:101:bash.0 Request processed in 6970us (7148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778299.268157:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:2.0:1789778299.272282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.272391:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296022912 00000100:00100000:1.0:1789778299.272402:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296022912 00000100:00100000:1.0:1789778299.272498:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1789778299.272508:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:10536:x1876718296022912:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:1.0:1789778299.273050:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:10536:x1876718296022912:12345-192.168.201.45@tcp:35:bash.0 Request processed in 541us (780us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789778299.273059:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000001:00080000:0.0:1789778299.390659:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789778299.443424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.443557:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296023040 00000100:00100000:2.0:1789778299.443579:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296023040 00000100:00100000:2.0:1789778299.443635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:2.0:1789778299.443647:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:10552:x1876718296023040:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778299.443681:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778299.443701:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c94 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.443773:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744145e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.443787:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744145e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.443798:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744145e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778299.443829:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789778299.443832:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778299.443850:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744145e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.443874:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c94 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.443892:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744145e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c94 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.443900:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778299.443903:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778299.443906:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8a00, rc 0) 00000100:00100000:2.0:1789778299.444034:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:10552:x1876718296023040:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 381us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.444042:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:3.0:1789778299.452799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.452974:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296023296 00000100:00100000:1.0:1789778299.452985:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296023296 00000100:00100000:1.0:1789778299.453049:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:1.0:1789778299.453059:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:10552:x1876718296023296:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778299.453111:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778299.453129:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441465 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7c9b expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.453401:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744146c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.453415:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744146c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.453427:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744146c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778299.453445:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789778299.453574:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441465 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c9b expref: 38 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.453591:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744146c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c9b expref: 37 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.453600:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e922c1b00) 00010000:00010000:1.0:1789778299.453603:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778299.453606:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321600, rc 0) 00000100:00100000:1.0:1789778299.453656:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:10552:x1876718296023296:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 599us (872us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789778299.453663:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:1.0:1789778299.460205:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.460333:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296023552 00000100:00100000:2.0:1789778299.460343:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296023552 00000100:00100000:2.0:1789778299.460406:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:2.0:1789778299.460415:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:10552:x1876718296023552:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778299.460440:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778299.460462:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c115744147a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ca2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.460551:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.460564:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.460576:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778299.460587:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789778299.460793:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c115744147a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ca2 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.460811:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ca2 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.460820:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e922c1b00) 00010000:00010000:2.0:1789778299.460823:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789778299.460839:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8800, rc 0) 00000100:00100000:2.0:1789778299.460905:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:10552:x1876718296023552:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 492us (711us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789778299.460913:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:0.0:1789778299.466590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778299.466636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.466766:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296023680 00000100:00100000:2.0:1789778299.466777:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296023680 00000100:00100000:2.0:1789778299.466851:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1789778299.466862:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:2375:x1876718296023680:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778299.466876:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778299.466899:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744146c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c9b expref: 39 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.466915:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e922c1b00) 00010000:00010000:2.0:1789778299.466920:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778299.466966:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:2375:x1876718296023680:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 107us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.466973:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1789778299.467048:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296023808 00000100:00100000:1.0:1789778299.467052:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296023808 00000100:00100000:1.0:1789778299.467117:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:1.0:1789778299.467125:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718296023808:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:1.0:1789778299.467175:0:8205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.467193:0:8205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.467202:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778299.467207:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789778299.467211:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.467261:0:8205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.467276:0:8205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 6 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.467290:0:8205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314914432:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778299.467349:0:8205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778299.470650:0:8205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314914432:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778299.470753:0:8205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778299.472563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.472883:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296023936 00000100:00100000:3.0:1789778299.472893:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296023936 00002000:00100000:3.0:1789778299.472946:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b3ec17da300 x1876718296023936/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:225/0 lens 504/0 e 0 to 0 dl 1789778310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789778299.472957:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec17da300 with x1876718296023936 ext(0->8) 00010000:00010000:3.0:1789778299.472967:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 7 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.472983:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 7 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778299.472991:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3ec17da300 00000100:00100000:3.0:1789778299.473034:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1789778299.473044:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296023936:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:3.0:1789778299.473866:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2374:x1876718296023936:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 819us (1308us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789778299.473875:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00002000:00100000:3.0:1789778299.473882:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b3ec17da300 x1876718296023936/t4294967302(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:225/0 lens 504/448 e 0 to 0 dl 1789778310 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789778299.473898:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec17da300 with x1876718296023936 ext(0->8) 00010000:00010000:3.0:1789778299.473905:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 9 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.473919:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 9 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778299.473926:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3ec17da300 00000100:00100000:0.0:1789778299.476872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.476962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296024064 00000100:00100000:3.0:1789778299.476974:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296024064 00010000:00010000:3.0:1789778299.477011:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 9 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.477296:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1789778299.477306:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2374:x1876718296024064:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778299.477320:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789778299.477339:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789778299.477342:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789778299 00002000:00010000:3.0:1789778299.477344:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789778299 00002000:00010000:3.0:1789778299.477346:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789778299 00010000:00010000:3.0:1789778299.477351:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 9 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.477364:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 9 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.477413:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005be3136e/0x5a1e1c1157441450 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c8d expref: 9 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.477430:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789778299.477434:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789778299.477441:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.477450:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.477482:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778299.477527:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296024064:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 223us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778299.477534:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00010000:00010000:0.0:1789778299.477591:0:8205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477600:0:8205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477625:0:8205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477633:0:8205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477642:0:8205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477649:0:8205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778299.477660:0:8205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477678:0:8205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477691:0:8205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.477697:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569fd5a1/0x5a1e1c115744148f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778299.477751:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296023808:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 10626us (11115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778299.477758:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1789778299.480060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.480630:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296024320 00000100:00100000:3.0:1789778299.480642:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296024320 00000100:00100000:3.0:1789778299.480712:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:3.0:1789778299.480722:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86777850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:10552:x1876718296024320:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:3.0:1789778299.480797:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ca2 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778299.481092:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1789778299.481149:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789778299.481487:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1789778299.481540:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.481561:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.481569:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.481603:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.481617:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 42 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.481630:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314914560:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778299.481718:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf4213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778299.485939:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314914560:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778299.485971:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.486176:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.486307:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296024448 00000100:00100000:3.0:1789778299.486315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296024448 00010000:00010000:3.0:1789778299.486352:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 43 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.486399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:3.0:1789778299.486408:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+43:2374:x1876718296024448:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778299.486425:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778299.486444:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 43 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.486457:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 43 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.486477:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c115744143b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c7f expref: 43 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.486491:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e922c1b00) 00010000:00010000:3.0:1789778299.486496:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.486505:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.486512:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.486652:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778299.486721:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+42:2374:x1876718296024448:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 313us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778299.486737:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00010000:00010000:0.0:1789778299.488545:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.488561:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789778299.488764:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789778299.488966:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789778299.489516:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314914688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789778299.489581:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778299.489663:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf35c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789778299.489852:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314914688 00000100:00100000:1.0:1789778299.489860:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314914688 00000100:00100000:1.0:1789778299.489965:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778299.489975:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314914688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789778299.490099:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314914688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.490107:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789778299.490267:0:5848:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789778299.490273:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1789778299.490297:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec1441880, transno 4294967301 00000100:00100000:3.0:1789778299.490321:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17d8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314914688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789778299.490909:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789778299.490977:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314914816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789778299.491023:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778299.491047:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778299.491088:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314914816 00000100:00100000:3.0:1789778299.491093:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314914816 00000100:00100000:3.0:1789778299.491118:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789778299.491125:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314914816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789778299.491262:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876718314914816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 137us (238us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789778299.491268:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789778299.491302:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e88de6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314914816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789778299.491342:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789778299.491389:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.491399:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.491407:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.491414:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44de00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778299.491418:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.491426:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.491442:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e922c1b00) 00010000:00010000:3.0:1789778299.491445:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789778299.491456:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.491462:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c1157441496 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789778299.491632:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789778299.491740:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789778299.491752:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354449686203ns, next at 355449684141ns, rc = 0 00000001:00080000:3.0:1789778299.491757:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789778299.491789:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e922c1b00) 00010000:00010000:3.0:1789778299.491793:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789778299.491799:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ca2 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.491892:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86777850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+45:10552:x1876718296024320:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 11172us (11841us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789778299.491900:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000020:00080000:3.0:1789778299.491903:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1789778299.492605:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778299.495450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.495623:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296024576 00000100:00100000:1.0:1789778299.495634:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296024576 00000100:00100000:1.0:1789778299.495792:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:1.0:1789778299.495804:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+45:10552:x1876718296024576:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778299.495829:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778299.495865:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744149d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.495925:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744149d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ca9 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.495940:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744149d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ca9 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.495957:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778299.495960:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778299.495963:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321800, rc 0) 00000100:00100000:1.0:1789778299.496021:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:10552:x1876718296024576:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 221us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.496035:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:0.0:1789778299.499561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.499660:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296024832 00000100:00100000:2.0:1789778299.499680:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296024832 00000100:00100000:2.0:1789778299.499740:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:2.0:1789778299.499750:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:10552:x1876718296024832:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778299.499985:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10552:x1876718296024832:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 236us (434us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789778299.499993:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00010000:00010000:2.0:1789778299.569795:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778299.579144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.579398:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296024960 00000100:00100000:1.0:1789778299.579408:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296024960 00000100:00100000:1.0:1789778299.579459:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:1.0:1789778299.579467:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10562:x1876718296024960:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:1.0:1789778299.579541:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579557:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579568:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579582:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579602:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579609:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579690:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579865:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579875:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789778299.579915:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579927:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579935:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579941:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579947:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778299.579951:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579958:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579975:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:1.0:1789778299.579978:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778299.579983:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.579989:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580004:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580009:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580015:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580020:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778299.580032:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580038:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580045:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e91b87700) 00010000:00010000:1.0:1789778299.580048:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778299.580050:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580057:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580327:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580334:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580340:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580345:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778299.580347:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580353:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580360:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778299.580362:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778299.580365:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.580370:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.580524:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10562:x1876718296024960:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1056us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.580540:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:0.0:1789778299.605505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.605604:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296025216 00000100:00100000:3.0:1789778299.605614:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296025216 00000100:00100000:3.0:1789778299.605667:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:3.0:1789778299.605678:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:10565:x1876718296025216:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778299.605803:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778299.605826:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574414b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cb0 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.605893:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.605923:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.605934:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.605948:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.605955:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.605961:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606321:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606330:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606338:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778299.606347:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789778299.606492:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606500:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606506:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606512:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44dc00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.606516:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606523:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606534:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778299.606537:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.606541:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606558:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c11574414c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606572:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606579:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606585:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606590:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44cc00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.606593:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606599:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606608:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5b00) 00010000:00010000:2.0:1789778299.606610:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.606612:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606617:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c11574414c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606658:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c11574414b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 50 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606671:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 49 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.606684:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778299.606686:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778299.606688:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8000, rc 0) 00000100:00100000:2.0:1789778299.606878:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:10565:x1876718296025216:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1199us (1380us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789778299.606887:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:0.0:1789778299.612515:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.612846:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296025344 00000100:00100000:3.0:1789778299.612857:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296025344 00000100:00100000:3.0:1789778299.612918:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:3.0:1789778299.612928:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:10565:x1876718296025344:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:3.0:1789778299.612991:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613006:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613018:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613232:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613259:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613266:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613272:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778299.613277:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613285:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613297:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:3.0:1789778299.613300:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789778299.613305:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.613311:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c11574414dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.613845:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:10565:x1876718296025344:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 915us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778299.613855:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:0.0:1789778299.619251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.619376:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296025600 00000100:00100000:2.0:1789778299.619386:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296025600 00000100:00100000:2.0:1789778299.619439:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1789778299.619448:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:10565:x1876718296025600:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778299.619704:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:10565:x1876718296025600:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 256us (461us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789778299.619712:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:0.0:1789778299.690890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.691626:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296025856 00000100:00100000:1.0:1789778299.691638:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296025856 00000100:00100000:1.0:1789778299.691716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:1.0:1789778299.691751:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:10575:x1876718296025856:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1789778299.691776:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778299.691780:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789778299.691809:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744145e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c94 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.691830:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:1.0:1789778299.691835:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778299.691848:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.691939:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.691952:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 50 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.691960:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.691991:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 50 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.692003:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 50 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.692016:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314914944:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778299.692184:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778299.696598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.696693:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314914944:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778299.696741:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.696864:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296025984 00000100:00100000:2.0:1789778299.696871:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296025984 00010000:00010000:2.0:1789778299.696907:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 51 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.696958:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:2.0:1789778299.696969:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:2374:x1876718296025984:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778299.696985:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778299.696991:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 51 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.697003:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 51 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.697051:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb0 expref: 51 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.697102:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778299.697107:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.697116:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.697123:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.697144:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778299.697186:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:2374:x1876718296025984:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 219us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.697192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00010000:00010000:1.0:1789778299.697257:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.697264:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778299.697280:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789778299.697408:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c11574414e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.697421:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.697429:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778299.697432:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789778299.697434:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320600, rc 0) 00000100:00100000:1.0:1789778299.697455:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:10575:x1876718296025856:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5710us (6577us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789778299.697462:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 104 00000100:00100000:0.0:1789778299.701295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.701388:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296026240 00000100:00100000:1.0:1789778299.701400:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296026240 00000100:00100000:1.0:1789778299.701462:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:1.0:1789778299.701472:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:10575:x1876718296026240:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:1.0:1789778299.701751:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.701775:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.701787:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789778299.701841:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789778299.701866:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3c565af reply state 0000000081aa142f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.701874:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789778299.701970:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:10575:x1876718296026240:12345-192.168.201.45@tcp:36:bash.0 Request processed in 498us (684us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789778299.701977:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00000020:00080000:1.0:1789778299.701983:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789778299.704649:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.704669:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.704676:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.704682:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778299.704687:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.704695:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.704747:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778299.704750:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778299.704756:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.704762:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574414f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778299.707258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.707347:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296026368 00000100:00100000:2.0:1789778299.707358:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296026368 00000100:00100000:2.0:1789778299.707423:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:2.0:1789778299.707434:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:10575:x1876718296026368:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778299.707460:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778299.707479:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cbe expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.707564:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.707595:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.707603:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.707635:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.707649:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 53 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.707663:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314915072:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778299.707770:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb9747780 going to sleep for 11 seconds 00000100:00100000:2.0:1789778299.710720:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314915072:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778299.710756:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778299.714415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.714741:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296026496 00000100:00100000:3.0:1789778299.714752:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296026496 00010000:00010000:3.0:1789778299.714795:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 54 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778299.714839:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:3.0:1789778299.714863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:2374:x1876718296026496:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778299.714877:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778299.714884:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 54 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.714897:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 54 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.714919:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c11574414ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cb7 expref: 54 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.714935:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:3.0:1789778299.714949:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.714958:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.714966:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778299.715160:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778299.715209:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:2374:x1876718296026496:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 349us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778299.715218:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00010000:00010000:1.0:1789778299.717561:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.717577:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778299.717634:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789778299.717638:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778299.717659:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.717710:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c11574414ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 53 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.717739:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 52 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.717748:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778299.717751:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778299.717755:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8a00, rc 0) 00000100:00100000:1.0:1789778299.717814:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:10575:x1876718296026368:12345-192.168.201.45@tcp:101:bash.0 Request processed in 10383us (10568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.717837:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 106 00000100:00100000:0.0:1789778299.721010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.725425:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296026752 00000100:00100000:3.0:1789778299.725442:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296026752 00000100:00100000:3.0:1789778299.725510:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:3.0:1789778299.725520:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:10575:x1876718296026752:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:3.0:1789778299.725992:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:10575:x1876718296026752:12345-192.168.201.45@tcp:35:bash.0 Request processed in 471us (4989us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789778299.726001:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:2.0:1789778299.789650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.789820:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296026880 00000100:00100000:1.0:1789778299.789831:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296026880 00000100:00100000:1.0:1789778299.789894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:1.0:1789778299.789904:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:10581:x1876718296026880:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778299.789927:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778299.789953:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744150d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cc5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.790012:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.790037:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.790048:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778299.790120:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789778299.790124:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778299.790149:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.790172:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744150d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cc5 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.790189:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cc5 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.790214:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:1.0:1789778299.790217:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778299.790221:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321c00, rc 0) 00000100:00100000:1.0:1789778299.790268:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:10581:x1876718296026880:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 365us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.790276:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 107 00000100:00100000:1.0:1789778299.795164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.795356:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296027008 00000100:00100000:2.0:1789778299.795376:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296027008 00000100:00100000:2.0:1789778299.795432:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:2.0:1789778299.795442:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:10581:x1876718296027008:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778299.795461:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778299.795481:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744151b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ccc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795561:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795576:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795587:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795601:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795608:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795615:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795811:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795820:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795828:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778299.795863:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789778299.795867:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778299.795884:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795906:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795915:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795921:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795928:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795934:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.795938:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795946:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795957:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778299.795960:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.795965:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795970:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795982:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795987:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.795998:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.796003:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778299.796006:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.796012:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.796881:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e922c1200) 00010000:00010000:2.0:1789778299.796888:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778299.796892:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.796900:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c1157441529 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.796943:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c115744151b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.796958:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.796965:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778299.796967:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778299.796970:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9800, rc 0) 00000100:00100000:2.0:1789778299.797050:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10581:x1876718296027008:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1608us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.797099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 108 00000100:00100000:3.0:1789778299.800748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778299.800799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.800899:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296027264 00000100:00100000:1.0:1789778299.800911:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296027264 00000100:00100000:1.0:1789778299.800977:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:1.0:1789778299.800988:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10581:x1876718296027264:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778299.801009:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778299.801042:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441537 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cd3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.801185:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.801202:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 56 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.801212:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.801220:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.801269:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.801282:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 56 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.801295:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314915200:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778299.801381:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 56 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.801391:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 56 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.801400:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314915328:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778299.801422:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777000 going to sleep for 11 seconds 00000100:00100000:2.0:1789778299.803511:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296027392 00000100:00100000:2.0:1789778299.803539:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296027392 00010000:00010000:2.0:1789778299.803587:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 57 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.803632:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1789778299.803642:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:2373:x1876718296027392:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778299.803656:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778299.803662:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 57 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.803675:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 57 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.803707:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778299.803713:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.803730:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.803737:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778299.803790:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:2373:x1876718296027392:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 150us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.803799:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:3.0:1789778299.809563:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:1.0:1789778299.809818:0:5845:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.45@tcp) returned -22 from blocking AST (req@000000004fc64ebc x1876718314915200) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 56 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.809840:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c1157441530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ccc expref: 56 pid: 5847 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778299.809856:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314915200:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778299.809869:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314915328:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778299.809892:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778299.809911:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.809920:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.809929:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.810265:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296027520 00000100:00100000:2.0:1789778299.810279:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296027520 00010000:00010000:2.0:1789778299.810315:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 56 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778299.810359:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:2.0:1789778299.810377:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:2375:x1876718296027520:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778299.810392:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778299.810398:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 56 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.810409:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 56 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.810429:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cbe expref: 56 pid: 8093 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.810440:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778299.810443:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.810450:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.810457:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.810474:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778299.810541:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:2375:x1876718296027520:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 162us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.810557:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00010000:00010000:1.0:1789778299.811181:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.811190:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778299.811208:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789778299.811356:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441537 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.811384:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.811392:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778299.811394:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789778299.811397:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321200, rc 0) 00000100:00100000:1.0:1789778299.811428:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10581:x1876718296027264:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 10442us (10718us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789778299.811437:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 109 00000100:00100000:3.0:1789778299.816052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778299.816245:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296027776 00000100:00100000:2.0:1789778299.816256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296027776 00000100:00100000:2.0:1789778299.816316:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1789778299.816326:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10581:x1876718296027776:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:2.0:1789778299.816343:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778299.816369:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744149d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ca9 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778299.816389:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778299.816395:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778299.816455:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:10581:x1876718296027776:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 130us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.816462:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1789778299.819337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778299.819688:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296027904 00000100:00100000:1.0:1789778299.819780:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296027904 00000100:00100000:1.0:1789778299.819855:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:1.0:1789778299.819865:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:10581:x1876718296027904:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:1.0:1789778299.819970:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.819987:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778299.819998:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789778299.820233:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789778299.820321:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:10581:x1876718296027904:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 457us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.820329:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 110 00000100:00100000:3.0:1789778299.823000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778299.823282:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296028032 00000100:00100000:0.0:1789778299.823291:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296028032 00000100:00100000:0.0:1789778299.823343:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:0.0:1789778299.823352:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:10581:x1876718296028032:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778299.823377:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778299.823394:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cda expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.823441:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.823450:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.823468:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.823479:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.823508:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:0.0:1789778299.823511:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778299.823515:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778299.823522:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757800, rc 0) 00000100:00100000:0.0:1789778299.823790:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10581:x1876718296028032:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 437us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778299.823796:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 111 00000100:00100000:1.0:1789778299.825299:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314915456:0@lo:400:kworker.0 00000100:00100000:1.0:1789778299.825351:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778299.825397:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314915968:0@lo:400:kworker.0 00000100:00100000:1.0:1789778299.825422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778299.825444:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778299.825449:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314915584:0@lo:400:kworker.0 00000100:00100000:1.0:1789778299.825467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778299.825488:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314915968 00000100:00100000:1.0:1789778299.825493:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314915968 00000100:00100000:1.0:1789778299.825545:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789778299.825552:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314915968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778299.825589:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314915968:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.825608:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789778299.825637:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789778299.825642:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1789778299.825660:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314915968:0@lo:400:kworker.0 00000100:00100000:1.0:1789778299.825675:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314915584 00000100:00100000:1.0:1789778299.825677:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314915584 00000100:00100000:1.0:1789778299.825979:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789778299.825988:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314915584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778299.826041:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314915584:12345-0@lo:400:kworker.0 Request processed in 53us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778299.826048:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789778299.826095:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314915584:0@lo:400:kworker.0 00000100:00100000:0.0:1789778299.826180:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314915712:0@lo:400:kworker.0 00000100:00100000:0.0:1789778299.826208:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778299.826235:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778299.826241:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314915840:0@lo:400:kworker.0 00000100:00100000:0.0:1789778299.826262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778299.826288:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314915712 00000100:00100000:0.0:1789778299.826292:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314915712 00000100:00100000:0.0:1789778299.826316:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314915840 00000100:00100000:0.0:1789778299.826319:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314915840 00000100:00100000:0.0:1789778299.826334:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789778299.826340:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314915712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778299.826373:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314915712:12345-0@lo:400:kworker.0 Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778299.826379:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789778299.826392:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789778299.826398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314915840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778299.826432:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314915840:12345-0@lo:400:kworker.0 Request processed in 35us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778299.826438:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789778299.826467:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314915840:0@lo:400:kworker.0 00000100:00100000:0.0:1789778299.826475:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314915712:0@lo:400:kworker.0 00000100:00080000:0.0:1789778299.826489:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789778299.826493:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778299.826795:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314915456 00000100:00100000:2.0:1789778299.826800:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314915456 00000100:00100000:2.0:1789778299.826837:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789778299.826843:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314915456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778299.826891:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314915456:12345-0@lo:400:kworker.0 Request processed in 49us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.826897:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789778299.826975:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314915456:0@lo:400:kworker.0 00000100:00100000:1.0:1789778299.827437:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778299.827446:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb9531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314916096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778299.827475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778299.827557:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314916096 00000100:00100000:2.0:1789778299.827561:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314916096 00000100:00100000:2.0:1789778299.827595:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789778299.827603:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876718314916096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778299.827627:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778299.827667:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876718314916096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778299.827673:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789778299.827836:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb9531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314916096:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789778300.337579:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778300.337590:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778300.337647:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789778300.337656:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789778300.337806:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314916224:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789778300.337932:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb97479c0 going to sleep for 11 seconds 00000004:00080000:0.0:1789778300.338107:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355296040956ns, next at 356296038828ns, rc = 0 00000100:00100000:1.0:1789778300.338254:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314916352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778300.338304:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778300.338461:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314916352 00000100:00100000:0.0:1789778300.338468:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314916352 00000100:00100000:0.0:1789778300.338519:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789778300.338529:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314916352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778300.338548:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789778300.338593:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314916352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.338600:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789778300.338815:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314916352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778300.344811:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.344941:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314916224:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789778300.347724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296028160 00000100:00100000:0.0:1789778300.347740:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296028160 00000100:00100000:0.0:1789778300.347865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:0.0:1789778300.347875:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10582:x1876718296028160:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789778300.347916:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789778300.348029:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10582:x1876718296028160:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 155us (3228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.348037:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 112 00000100:00100000:3.0:1789778300.355395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.356993:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296028288 00000100:00100000:1.0:1789778300.357016:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296028288 00000100:00100000:1.0:1789778300.357102:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:1.0:1789778300.357114:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10582:x1876718296028288:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789778300.357199:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357622:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357636:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357705:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357722:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357729:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357752:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357761:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357767:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778300.357813:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789778300.357818:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778300.357832:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357844:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357860:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357866:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357872:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.357877:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357884:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357896:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:1.0:1789778300.357899:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778300.357904:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357911:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744155a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357926:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357932:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357937:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357942:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.357953:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357960:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357968:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b3e91b87700) 00010000:00010000:1.0:1789778300.357970:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778300.357973:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357979:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441561 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357994:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.357999:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.358005:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.358021:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.358024:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.358031:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.358038:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778300.358041:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778300.358058:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.358106:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778300.358723:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10582:x1876718296028288:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 1595us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.358735:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 113 00000100:00100000:1.0:1789778300.361641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.361682:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296028544 00000100:00100000:1.0:1789778300.361692:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296028544 00000100:00100000:1.0:1789778300.361753:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:1.0:1789778300.361764:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:10582:x1876718296028544:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778300.361785:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778300.361806:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744156f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ce1 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.361912:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.361930:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.361941:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778300.361952:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789778300.362093:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362117:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362125:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362130:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.362135:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362142:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362153:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778300.362156:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789778300.362160:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362166:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362204:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744156f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ce1 expref: 57 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362226:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:1.0:1789778300.362228:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789778300.362232:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c115744156f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ce1 expref: 57 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.362240:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321a00, rc 0) 00000100:00100000:1.0:1789778300.362294:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:10582:x1876718296028544:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 533us (666us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789778300.362301:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 114 00000100:00100000:0.0:1789778300.365599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.365854:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296028672 00000100:00100000:1.0:1789778300.365865:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296028672 00000100:00100000:1.0:1789778300.365919:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:1.0:1789778300.365930:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:10582:x1876718296028672:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789778300.365968:0:8093:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789778300.368808:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:10582:x1876718296028672:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 2868us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.368824:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 115 00000100:00100000:3.0:1789778300.374942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.375031:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296028928 00000100:00100000:0.0:1789778300.375050:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296028928 00000100:00100000:0.0:1789778300.375138:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:0.0:1789778300.375149:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:10582:x1876718296028928:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778300.375171:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778300.375175:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789778300.375203:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cc5 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.375242:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778300.375247:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789778300.375260:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441584 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ce8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789778300.375874:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789778300.376105:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744158b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.376119:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744158b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.376129:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744158b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.376182:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441584 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ce8 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.376197:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744158b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ce8 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.377796:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a900) 00010000:00010000:0.0:1789778300.377800:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778300.377804:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757200, rc 0) 00000100:00100000:0.0:1789778300.377886:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:10582:x1876718296028928:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2736us (2951us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789778300.377895:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:3.0:1789778300.391164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.391285:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296029184 00000100:00100000:0.0:1789778300.391295:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296029184 00000100:00100000:0.0:1789778300.391362:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:0.0:1789778300.391374:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:10582:x1876718296029184:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789778300.391433:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778300.391460:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744158b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ce8 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391478:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a900) 00010000:00010000:0.0:1789778300.391488:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789778300.391510:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391536:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391547:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391562:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391587:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391593:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391656:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391663:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391670:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391676:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778300.391681:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391688:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391697:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:0.0:1789778300.391700:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778300.391704:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391718:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441599 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391728:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391740:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391746:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391751:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778300.391754:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391761:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391769:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5222dd08 (ffff9b3ea4c7ae00) 00010000:00010000:0.0:1789778300.391771:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778300.391774:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.391779:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c11574415a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5222dd08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.391865:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:10582:x1876718296029184:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 493us (708us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789778300.391872:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:3.0:1789778300.394865:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.394978:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296029312 00000100:00100000:0.0:1789778300.394991:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296029312 00000100:00100000:0.0:1789778300.395055:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:0.0:1789778300.395084:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:10582:x1876718296029312:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778300.395104:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778300.395134:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574415a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cef expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.395166:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.395177:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.395185:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.395260:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574415a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.395272:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.395278:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:0.0:1789778300.395280:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789778300.395282:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3000, rc 0) 00000100:00100000:0.0:1789778300.395332:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:10582:x1876718296029312:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 271us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.395337:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:3.0:1789778300.397259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.397456:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296029568 00000100:00100000:0.0:1789778300.397467:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296029568 00000100:00100000:0.0:1789778300.397523:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:0.0:1789778300.397533:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:10582:x1876718296029568:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789778300.397611:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.397640:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.397651:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789778300.398027:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1789778300.398159:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006aaa5c8c reply state 000000003b3b59a0 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.398169:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789778300.398291:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:10582:x1876718296029568:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 757us (1039us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789778300.398299:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:3.0:1789778300.399869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:1.0:1789778300.399944:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.399954:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.399961:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.399967:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.399972:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.399980:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.400008:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:1.0:1789778300.400016:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789778300.400021:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.400027:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574415b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.400158:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296029696 00000100:00100000:0.0:1789778300.400167:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296029696 00000100:00100000:0.0:1789778300.400268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:0.0:1789778300.400278:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:10582:x1876718296029696:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778300.400300:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778300.400318:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cf6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.400368:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.400382:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.400400:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:0.0:1789778300.400403:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778300.400405:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2800, rc 0) 00000100:00100000:0.0:1789778300.400475:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:10582:x1876718296029696:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 199us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.400482:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:3.0:1789778300.406792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.406854:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296029824 00000100:00100000:2.0:1789778300.406865:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296029824 00000100:00100000:2.0:1789778300.406994:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:2.0:1789778300.407004:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718296029824:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789778300.407378:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296029824:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 374us (593us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789778300.407386:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00080000:0.0:1789778300.407723:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778300.411781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.411835:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296030080 00000100:00100000:2.0:1789778300.411846:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296030080 00000100:00100000:2.0:1789778300.411917:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:2.0:1789778300.411926:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:10582:x1876718296030080:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789778300.412394:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:10582:x1876718296030080:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 465us (619us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789778300.412418:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:3.0:1789778300.415143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.415207:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296030336 00000100:00100000:2.0:1789778300.415216:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296030336 00000100:00100000:2.0:1789778300.415333:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:2.0:1789778300.415344:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:10582:x1876718296030336:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789778300.415469:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:10582:x1876718296030336:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 126us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778300.415477:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:3.0:1789778300.418548:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.418649:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296030464 00000100:00100000:2.0:1789778300.418659:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296030464 00000100:00100000:2.0:1789778300.418782:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:2.0:1789778300.418793:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:10582:x1876718296030464:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778300.418811:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778300.418832:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c11574415c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7cfd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.418906:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.418920:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.418932:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778300.418966:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778300.418988:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.419034:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c11574415c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cfd expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.419053:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cfd expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.419061:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:2.0:1789778300.419113:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789778300.419118:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8e00, rc 0) 00000100:00100000:2.0:1789778300.419180:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:10582:x1876718296030464:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 389us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778300.419187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 122 00000100:00100000:3.0:1789778300.422521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.422618:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296030592 00000100:00100000:1.0:1789778300.422627:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296030592 00000100:00100000:1.0:1789778300.422695:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1789778300.422706:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296030592:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778300.422735:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778300.422757:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d04 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789778300.422784:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd97c, blocks: 0x1 00010000:00010000:1.0:1789778300.422805:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1789778300.422811:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778300.422821:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.422840:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.422853:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321a00, rc 0) 00000100:00100000:1.0:1789778300.422913:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2372:x1876718296030592:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 209us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.422933:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:3.0:1789778300.436038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.436469:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296030848 00000100:00100000:1.0:1789778300.436480:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296030848 00000100:00100000:1.0:1789778300.436551:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:1.0:1789778300.436561:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:10582:x1876718296030848:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789778300.436666:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:10582:x1876718296030848:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 105us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.436672:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:3.0:1789778300.441784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.441956:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296030976 00000100:00100000:2.0:1789778300.441966:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296030976 00000100:00100000:2.0:1789778300.442041:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:2.0:1789778300.442053:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:10582:x1876718296030976:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778300.442109:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778300.442127:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d0b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.442162:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.442171:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778300.442176:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778300.442182:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.442232:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.442247:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 9 pid: 6693 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.442261:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1876718314916480:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778300.442354:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb97479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778300.445367:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1876718314916480:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778300.445406:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.445428:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9200, rc 0) 00000100:00100000:2.0:1789778300.445489:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:10582:x1876718296030976:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3439us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778300.445499:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1789778300.447349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.448397:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296031104 00000100:00100000:2.0:1789778300.448409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296031104 00010000:00010000:2.0:1789778300.448455:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 9 pid: 6693 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.448502:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:2.0:1789778300.448511:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2374:x1876718296031104:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778300.448550:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778300.448573:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 9 pid: 6693 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.448587:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 9 pid: 6693 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.448610:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c11574415d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d04 expref: 9 pid: 6693 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.448627:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778300.448632:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778300.448641:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.448651:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.448688:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.448704:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876718314916608:192.168.201.45@tcp:105: 00000100:00100000:2.0:1789778300.448803:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb97479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778300.453406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.453644:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876718314916608:192.168.201.45@tcp:105: 00010000:00010000:2.0:1789778300.453666:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778300.453741:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296031104:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 5230us (6399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778300.453752:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:0.0:1789778300.453826:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296031232 00000100:00100000:0.0:1789778300.453832:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296031232 00002000:00100000:0.0:1789778300.453872:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b3ec15e0000 x1876718296031232/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:226/0 lens 504/0 e 0 to 0 dl 1789778311 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789778300.453883:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec15e0000 with x1876718296031232 ext(0->12) 00002000:00010000:0.0:1789778300.453887:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec15e0000 00000100:00100000:0.0:1789778300.453914:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:0.0:1789778300.453923:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296031232:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789778300.454315:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2374:x1876718296031232:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 391us (917us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789778300.454322:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00002000:00100000:0.0:1789778300.454328:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b3ec15e0000 x1876718296031232/t4294967309(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:226/0 lens 504/448 e 0 to 0 dl 1789778311 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789778300.454337:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec15e0000 with x1876718296031232 ext(0->12) 00002000:00010000:0.0:1789778300.454341:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec15e0000 00000100:00100000:0.0:1789778300.461212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778300.461292:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296031360 00000100:00100000:3.0:1789778300.461302:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296031360 00000100:00100000:3.0:1789778300.461358:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 124 00000100:00100000:3.0:1789778300.461382:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:10582:x1876718296031360:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789778300.550959:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1789778300.550979:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789778300.551041:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3ebfb633c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789778300.551047:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e9576ea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3ebfb63b40 00000020:00080000:3.0:1789778300.551050:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e9576e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3eb9524800 00000001:00080000:3.0:1789778300.551093:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1789778300.551115:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789778300.551132:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3ebf421f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789778300.551134:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e9576ed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3ebf4213c0 00000100:00100000:1.0:1789778300.551135:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:10582:x1876718296031360:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 89749us (89933us total) trans 0 rc 0/0 00000020:00080000:3.0:1789778300.551137:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e9576e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3e812e9800 00000100:00100000:1.0:1789778300.551144:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 124 00000004:00080000:3.0:1789778300.551148:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789778300.551167:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789778300.551342:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789778300.551505:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778300.551505:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778300.551521:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314916864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789778300.551569:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778300.551629:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314916864 00000100:00100000:0.0:1789778300.551636:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314916864 00000100:00100000:0.0:1789778300.551690:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789778300.551700:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314916864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789778300.551738:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789778300.551762:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.551783:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 9 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.551791:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789778300.551795:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778300.551799:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.551826:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 9 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.551841:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 9 pid: 8205 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.551852:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1454e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876718314916992:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778300.551896:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf35c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778300.552452:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314916736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789778300.552486:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778300.552637:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314916736 00000100:00100000:0.0:1789778300.552642:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314916736 00000100:00100000:0.0:1789778300.552870:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789778300.552879:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314916736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789778300.552910:0:8205:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1789778300.552938:0:8205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aadd97b, atime: 0x6aadd97b, ctime: 0x6aadd97b, blocks: 0x1 00010000:00010000:0.0:1789778300.552945:0:8205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.552958:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1789778300.552962:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778300.552968:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.552984:0:8205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.552993:0:8205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.553001:0:8205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.553025:0:8205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789778300.554971:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1876718314916736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2087us (2476us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789778300.554982:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1789778300.555122:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec15e2680/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789778300.555130:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314916736:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789778300.557374:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778300.557389:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.557402:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778300.557408:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.557439:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.557461:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.557469:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002569c7cc/0x5a1e1c11574415e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.557571:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778300.557574:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778300.557576:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778300.560101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.560147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778300.562321:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1454e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876718314916992:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778300.562349:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778300.563381:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296031488 00000100:00100000:1.0:1789778300.563393:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296031488 00010000:00010000:1.0:1789778300.563435:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 10 pid: 8205 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778300.563459:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:1.0:1789778300.563466:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2375:x1876718296031488:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778300.563477:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778300.563481:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 10 pid: 8205 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.563500:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 10 pid: 8205 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.563518:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c11574413a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c6a expref: 10 pid: 8205 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.563530:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789778300.563534:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789778300.563537:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.563543:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.563560:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778300.563600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296031488:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 135us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.563604:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1789778300.564127:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296031616 00000100:00100000:2.0:1789778300.564132:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296031616 00010000:00010000:3.0:1789778300.565100:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.565114:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.565125:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.565225:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.565245:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789778300.565848:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314916864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14145us (14273us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789778300.565857:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789778300.565930:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:3.0:1789778300.565939:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296031616:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789778300.566367:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec1455180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789778300.566380:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314916864:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789778300.566517:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778300.566525:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.566534:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778300.566538:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.566548:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.566566:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.566572:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdd82565/0x5a1e1c11574415df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.566592:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778300.566593:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778300.566595:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778300.594602:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789778300.616346:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789778300.616373:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1789778300.616523:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296031616:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 50579us (56380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.616534:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1789778300.619409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.622990:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296031872 00000100:00100000:2.0:1789778300.623008:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296031872 00000100:00100000:2.0:1789778300.623156:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:2.0:1789778300.623166:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10582:x1876718296031872:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789778300.623216:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778300.623240:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cfd expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.623261:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:2.0:1789778300.623266:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778300.623292:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.623304:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.623314:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778300.623555:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cc0b22c reply state 00000000c558d48f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.623564:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778300.623669:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:10582:x1876718296031872:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 504us (4269us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789778300.623676:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 125 00000100:00100000:0.0:1789778300.626572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:1.0:1789778300.626650:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.626662:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.626669:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.626675:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.626680:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.626687:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.626704:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:1.0:1789778300.626715:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778300.626721:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.626727:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574415ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778300.626890:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296032000 00000100:00100000:3.0:1789778300.626900:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296032000 00000100:00100000:3.0:1789778300.626958:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1789778300.626968:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718296032000:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789778300.627444:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789778300.627449:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789778299 00002000:00010000:3.0:1789778300.627452:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789778299 00002000:00010000:3.0:1789778300.627454:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789778300 -> 1789778299 00002000:00010000:3.0:1789778300.627456:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789778300.627517:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296032000:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 550us (953us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789778300.627524:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:3.0:1789778300.634948:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.635105:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296032256 00000100:00100000:2.0:1789778300.635117:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296032256 00000100:00100000:2.0:1789778300.635188:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:2.0:1789778300.635198:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:10582:x1876718296032256:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789778300.635267:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.635289:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.635298:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.635333:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.635346:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 15 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.635361:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314917120:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778300.635434:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb97470c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778300.639225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.639313:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296032384 00000100:00100000:0.0:1789778300.639324:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296032384 00010000:00010000:0.0:1789778300.639363:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 16 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.639420:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:0.0:1789778300.639431:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:2374:x1876718296032384:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778300.639445:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778300.639453:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 16 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.639466:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 16 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.639490:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:0.0:1789778300.639495:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.639505:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.639512:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.639543:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778300.639602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:2374:x1876718296032384:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 173us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.639610:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00010000:00010000:2.0:1789778300.641334:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574415ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cef expref: 15 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.641359:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314917120:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778300.641383:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641393:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641399:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641428:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641450:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641458:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641463:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778300.641468:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641475:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641489:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:2.0:1789778300.641492:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789778300.641497:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.641502:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574415f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.643431:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10582:x1876718296032256:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 8224us (8485us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789778300.643445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 126 00000100:00100000:3.0:1789778300.651205:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.651340:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296032512 00000100:00100000:0.0:1789778300.651359:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296032512 00000100:00100000:0.0:1789778300.651422:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1789778300.651433:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296032512:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789778300.651494:0:8205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.651513:0:8205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.651524:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778300.651528:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778300.651533:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.651568:0:8205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.651583:0:8205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 7 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.651596:0:8205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1457800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8205:1876718314917248:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778300.651681:0:8205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf35ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789778300.657028:0:8205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1457800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8205:1876718314917248:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778300.657059:0:8205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778300.657658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.657936:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296032640 00000100:00100000:0.0:1789778300.657945:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296032640 00010000:00010000:0.0:1789778300.657982:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.658048:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:0.0:1789778300.658058:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296032640:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778300.658091:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778300.658114:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.658127:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.658151:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a503e8c/0x5a1e1c11574415d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d0b expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.658167:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778300.658171:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778300.658177:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.658186:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.658209:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778300.658268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296032640:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 210us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.658276:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00010000:00010000:1.0:1789778300.658393:0:8205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658402:0:8205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658428:0:8205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658441:0:8205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658448:0:8205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658455:0:8205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778300.658460:0:8205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658468:0:8205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658480:0:8205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.658487:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4363c0/0x5a1e1c11574415fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778300.658531:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718296032512:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 7101us (7338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.658538:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:1.0:1789778300.661364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.661444:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296032896 00000100:00100000:2.0:1789778300.661454:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296032896 00000100:00100000:2.0:1789778300.661512:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 127 00000100:00100000:2.0:1789778300.661522:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10582:x1876718296032896:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789778300.661597:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.661631:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.661642:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.661862:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.661872:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.661879:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.661922:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.661937:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 15 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778300.661951:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314917376:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778300.662036:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb97470c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778300.664409:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314917376:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778300.664450:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778300.668921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.669679:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296033024 00000100:00100000:0.0:1789778300.669691:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296033024 00010000:00010000:0.0:1789778300.669743:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 16 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.669788:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1789778300.669798:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:2375:x1876718296033024:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778300.669812:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778300.669819:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 16 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.669833:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 16 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.669857:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574415bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cf6 expref: 16 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.669874:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:0.0:1789778300.669880:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.669889:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.669896:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.669917:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778300.669977:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:2375:x1876718296033024:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 181us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.670000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00010000:00010000:1.0:1789778300.670726:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.670736:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789778300.670935:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789778300.671130:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789778300.671506:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789778300.671592:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314917504:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789778300.671657:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778300.671695:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778300.671760:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314917504 00000100:00100000:0.0:1789778300.671768:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314917504 00000100:00100000:0.0:1789778300.671817:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789778300.671828:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8093:x1876718314917504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789778300.672361:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8093:x1876718314917504:12345-0@lo:1000:mdt00_003.0 Request processed in 524us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.672370:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789778300.673238:0:8093:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789778300.673246:0:8093:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec1455180, transno 4294967310 00000100:00100000:1.0:1789778300.673268:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314917504:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789778300.673976:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789778300.674338:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314917632:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789778300.674469:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778300.674550:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eabb953c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778300.674768:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314917632 00000100:00100000:3.0:1789778300.674775:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314917632 00000100:00100000:3.0:1789778300.674863:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789778300.674873:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8093:x1876718314917632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789778300.675128:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8093:x1876718314917632:12345-0@lo:1000:mdt00_003.0 Request processed in 255us (657us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789778300.675332:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314917632:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789778300.675385:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675396:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675417:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675423:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.675427:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675435:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675453:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a600) 00010000:00010000:1.0:1789778300.675456:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778300.675460:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675466:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c1157441609 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675496:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675503:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675508:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675512:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778300.675515:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675531:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675541:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778300.675543:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778300.675549:0:8093:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675559:0:8093:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675568:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778300.675598:0:8093:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778300.675610:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314917760:192.168.201.45@tcp:105: 00000100:00100000:1.0:1789778300.675693:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777000 going to sleep for 11 seconds 00000100:00100000:3.0:1789778300.678491:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789778300.678809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778300.678897:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314917760:192.168.201.45@tcp:105: 00010000:00010000:3.0:1789778300.678923:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.678934:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c115744154c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.678965:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.678980:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.678992:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679002:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679018:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679041:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679047:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778300.679051:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679058:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679177:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:3.0:1789778300.679181:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778300.679185:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679191:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c1157441610 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679201:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679207:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679213:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679217:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778300.679220:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679234:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679242:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:3.0:1789778300.679244:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789778300.679247:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.679252:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441602 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.679573:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296033152 00000100:00100000:0.0:1789778300.679582:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296033152 00000100:00100000:0.0:1789778300.679623:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:0.0:1789778300.679632:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10581:x1876718296033152:12345-192.168.201.45@tcp:49:lfs.0 00000100:00100000:0.0:1789778300.679766:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:10581:x1876718296033152:12345-192.168.201.45@tcp:49:lfs.0 Request processed in 134us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.679773:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:3.0:1789778300.679933:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:10582:x1876718296032896:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 18412us (18587us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1789778300.679941:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 127 00000020:00080000:3.0:1789778300.679945:0:8093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789778300.682342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.682531:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296033408 00000100:00100000:0.0:1789778300.682542:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296033408 00000100:00100000:0.0:1789778300.682596:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1789778300.682606:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86774050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:10582:x1876718296033408:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789778300.683329:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789778300.683433:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789778300.683479:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683494:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683517:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683526:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683532:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683538:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683557:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789778300.683654:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86774050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:10582:x1876718296033408:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 1046us (1318us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789778300.683662:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000020:00080000:0.0:1789778300.683667:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789778300.683727:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778300.683733:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683741:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778300.683744:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683752:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683764:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b3ea4c7a400) 00010000:00010000:0.0:1789778300.683767:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789778300.683779:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683785:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441617 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.683803:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778300.683804:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778300.683806:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778300.690936:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789778300.690945:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778300.691807:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789778300.691819:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789778300.691850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.691906:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.691955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.692029:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296033792 00000100:00100000:1.0:1789778300.692039:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296033792 00000100:00100000:1.0:1789778300.692126:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:1.0:1789778300.692152:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718296033792:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778300.692187:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296033664 00000100:00100000:3.0:1789778300.692191:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296033664 00000100:00100000:3.0:1789778300.692222:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:1.0:1789778300.692223:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718296033792:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778300.692229:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296033664:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778300.692243:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:3.0:1789778300.692254:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296033664:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778300.692260:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00080000:2.0:1789778300.692377:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778300.692843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296033536 00000100:00100000:0.0:1789778300.692849:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296033536 00000100:00100000:0.0:1789778300.692945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 289 00000100:00100000:0.0:1789778300.692955:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2374:x1876718296033536:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778300.693011:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2374:x1876718296033536:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 50us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.693019:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 289 00000100:00100000:3.0:1789778300.697275:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778300.698153:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296034048 00000100:00100000:1.0:1789778300.698166:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296034048 00000100:00100000:1.0:1789778300.698228:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:1.0:1789778300.698238:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:10581:x1876718296034048:12345-192.168.201.45@tcp:58:lfs.0 00000040:00080000:1.0:1789778300.698671:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789778300.698779:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:10581:x1876718296034048:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 540us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778300.698787:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 128 00000100:00100000:1.0:1789778300.738204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778300.738561:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296034176 00000100:00100000:3.0:1789778300.738573:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296034176 00000100:00100000:3.0:1789778300.738635:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 129 00000100:00100000:3.0:1789778300.738646:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:10584:x1876718296034176:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778300.738690:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778300.738720:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c115744161e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.738786:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.738802:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.738813:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.738829:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.738836:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.738842:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.739106:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.739118:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.739125:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.739158:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778300.739179:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 21 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778300.739193:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314917888:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778300.739483:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421540 going to sleep for 11 seconds 00000100:00100000:3.0:1789778300.746965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778300.747405:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314917888:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778300.747444:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.748947:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296034432 00000100:00100000:0.0:1789778300.748962:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296034432 00000100:00100000:0.0:1789778300.749028:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:0.0:1789778300.749039:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:5626:x1876718296034432:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789778300.749317:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:5626:x1876718296034432:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 279us (2361us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789778300.749325:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:3.0:1789778300.751692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778300.752025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296034560 00000100:00100000:0.0:1789778300.752049:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296034560 00010000:00010000:0.0:1789778300.752125:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 23 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778300.752172:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:0.0:1789778300.752182:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:2374:x1876718296034560:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778300.752197:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778300.752204:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 23 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.752217:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 23 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.752240:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c115744153e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cd3 expref: 23 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.752256:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:0.0:1789778300.752261:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.752271:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.752278:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778300.752368:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778300.752424:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:2374:x1876718296034560:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 243us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778300.752440:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00010000:00010000:2.0:1789778300.757534:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757552:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778300.757603:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789778300.757608:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778300.757630:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757644:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757653:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757659:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757665:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757670:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778300.757674:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757681:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757730:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:2.0:1789778300.757732:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778300.757738:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757745:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d400/0x5a1e1c1157441625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757764:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757771:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757776:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757781:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44de00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778300.757783:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757789:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757797:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b3e82bb5200) 00010000:00010000:2.0:1789778300.757800:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778300.757803:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757808:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44de00/0x5a1e1c115744162c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757861:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d200/0x5a1e1c115744161e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d12 expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757873:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d12 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778300.757880:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778300.757882:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778300.757885:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44cc00, rc 0) 00000100:00100000:2.0:1789778300.758247:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10584:x1876718296034176:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 19600us (20054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778300.758257:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 129 00000040:00080000:2.0:1789778301.538297:0:12106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778301.538307:0:12106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778301.538432:0:12106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789778301.538439:0:12106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789778301.637157:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778301.746211:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789778301.746220:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778301.746276:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789778301.746284:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789778301.746408:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1455500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314918016:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789778301.746506:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf35c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789778301.751317:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1455500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314918016:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789778301.752733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778301.752945:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296034688 00000100:00100000:3.0:1789778301.752955:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296034688 00000100:00100000:3.0:1789778301.753090:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:3.0:1789778301.753102:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10597:x1876718296034688:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789778301.753137:0:8093:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1789778301.753139:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778301.753243:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10597:x1876718296034688:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 143us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778301.753251:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 130 00000100:00100000:3.0:1789778301.760313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778301.760470:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296034944 00000100:00100000:2.0:1789778301.760485:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296034944 00000100:00100000:2.0:1789778301.760537:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:2.0:1789778301.760547:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:10597:x1876718296034944:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778301.760567:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778301.760592:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744163a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d19 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778301.760707:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778301.760730:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778301.760743:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778301.760756:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789778301.760882:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744163a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d19 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778301.760899:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d19 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778301.760908:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778301.760911:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778301.760914:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9200, rc 0) 00000100:00100000:2.0:1789778301.760980:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:10597:x1876718296034944:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 435us (676us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789778301.760987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 131 00000100:00100000:3.0:1789778301.772474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778301.772554:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296035200 00000100:00100000:1.0:1789778301.772564:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296035200 00000100:00100000:1.0:1789778301.772619:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 132 00000100:00100000:1.0:1789778301.772629:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:10597:x1876718296035200:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789778301.772723:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772741:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772753:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772937:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772945:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772959:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772965:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778301.772970:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772977:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.772991:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778301.772994:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789778301.773000:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778301.773006:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744164f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778301.773187:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:10597:x1876718296035200:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 558us (721us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789778301.773196:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 132 00000040:00080000:0.0:1789778301.773452:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789778301.773458:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778301.773937:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789778301.773946:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789778301.783453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778301.793257:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296035328 00000100:00100000:0.0:1789778301.793276:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296035328 00000100:00100000:0.0:1789778301.793356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1789778301.793368:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:2372:x1876718296035328:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778301.793384:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778301.793412:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d19 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778301.793434:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:0.0:1789778301.793440:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778301.793508:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:2372:x1876718296035328:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 142us (10061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778301.793516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:2.0:1789778301.793660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778301.795455:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296035584 00000100:00100000:0.0:1789778301.795469:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296035584 00000100:00100000:0.0:1789778301.795568:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1789778301.795579:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:10597:x1876718296035584:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789778301.795845:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:10597:x1876718296035584:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 267us (2185us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789778301.795854:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00010000:00010000:0.0:1789778302.641311:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789778303.345857:0:12157:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778303.345866:0:12157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778303.345911:0:12157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789778303.345917:0:12157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789778303.509327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778303.509535:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296035840 00000100:00100000:2.0:1789778303.509544:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296035840 00000100:00100000:2.0:1789778303.509665:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00100000:2.0:1789778303.509689:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:10617:x1876718296035840:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778303.509715:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778303.509747:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441656 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d20 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778303.509848:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744165d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778303.509863:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744165d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778303.509876:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744165d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778303.509888:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789778303.510004:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441656 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d20 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778303.510021:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744165d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d20 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778303.510029:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:2.0:1789778303.510032:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789778303.510036:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9800, rc 0) 00000100:00100000:2.0:1789778303.510114:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:10617:x1876718296035840:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 429us (798us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789778303.510121:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 133 00000100:00080000:3.0:1789778303.510176:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778303.517163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778303.517323:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296035968 00000100:00100000:1.0:1789778303.517334:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296035968 00000100:00100000:1.0:1789778303.517389:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:1.0:1789778303.517398:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:10617:x1876718296035968:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1789778303.517481:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517497:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517523:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517550:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517556:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517563:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517568:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778303.517572:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517579:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517590:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778303.517593:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789778303.517598:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.517604:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321800/0x5a1e1c115744166b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778303.517698:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:10617:x1876718296035968:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 300us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778303.517706:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 134 00000100:00100000:2.0:1789778303.608989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778303.609191:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036096 00000100:00100000:1.0:1789778303.609212:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036096 00000100:00100000:1.0:1789778303.609271:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:1.0:1789778303.609279:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718296036096:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:1.0:1789778303.609292:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778303.609308:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c1157441672 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d27 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789778303.609328:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aadd97b, atime: 0x6aadd97b, ctime: 0x6aadd97b, blocks: 0xb 00010000:00010000:1.0:1789778303.609342:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1789778303.609346:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778303.609353:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c1157441672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d27 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.609369:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c1157441672 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d27 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778303.609381:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321800, rc 0) 00000100:00100000:1.0:1789778303.609462:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296036096:12345-192.168.201.45@tcp:101:cat.0 Request processed in 183us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778303.609469:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00080000:3.0:1789778303.609531:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778303.612606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778303.612762:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036224 00000100:00100000:3.0:1789778303.612773:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036224 00002000:00100000:3.0:1789778303.612828:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b3ec1455500 x1876718296036224/t0(0) o3->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:229/0 lens 488/0 e 0 to 0 dl 1789778314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789778303.612839:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec1455500 with x1876718296036224 ext(0->4095) 00002000:00010000:3.0:1789778303.612861:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec1455500 00000100:00100000:3.0:1789778303.612895:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:3.0:1789778303.612905:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296036224:12345-192.168.201.45@tcp:3:cat.0 00000100:00100000:2.0:1789778303.613598:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296036224:12345-192.168.201.45@tcp:3:cat.0 Request processed in 691us (999us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789778303.613625:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00002000:00100000:2.0:1789778303.613634:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b3ec1455500 x1876718296036224/t0(0) o3->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:229/0 lens 488/4536 e 0 to 0 dl 1789778314 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789778303.613643:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec1455500 with x1876718296036224 ext(0->4095) 00002000:00010000:2.0:1789778303.613647:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec1455500 00010000:00010000:2.0:1789778303.665717:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789778304.472159:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789778304.472183:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:0.0:1789778304.690251:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778304.945563:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789778304.945588:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314918144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778304.945695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778304.945869:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314918144 00000100:00100000:3.0:1789778304.945877:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314918144 00000100:00100000:3.0:1789778304.945948:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789778304.945958:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314918144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778304.945992:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778304.946040:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314918144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778304.946047:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789778304.946114:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789778304.946120:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789778304.946138:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec15e2680, transno 4294967304 00000100:00100000:3.0:1789778304.946156:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314918144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778304.946864:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314918400:0@lo:400:kworker.0 00000100:00100000:0.0:1789778304.946903:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778304.947010:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314918272:0@lo:400:kworker.0 00000100:00100000:3.0:1789778304.947042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778304.947092:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314918784:0@lo:400:kworker.0 00000100:00100000:3.0:1789778304.947117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778304.947147:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314918272 00000100:00100000:3.0:1789778304.947151:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314918272 00000100:00100000:3.0:1789778304.947181:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789778304.947188:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314918272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778304.947241:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314918272:12345-0@lo:400:kworker.0 Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778304.947248:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789778304.947420:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314918400 00000100:00100000:0.0:1789778304.947424:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314918400 00000100:00100000:0.0:1789778304.947465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789778304.947472:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314918400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778304.947509:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314918400:12345-0@lo:400:kworker.0 Request processed in 38us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778304.947515:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789778304.947543:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314918400:0@lo:400:kworker.0 00000100:00100000:0.0:1789778304.947561:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314918528:0@lo:400:kworker.0 00000100:00100000:0.0:1789778304.947583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778304.947603:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778304.947608:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314918656:0@lo:400:kworker.0 00000100:00100000:1.0:1789778304.947767:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314918528 00000100:00100000:1.0:1789778304.947772:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314918528 00000100:00100000:1.0:1789778304.947802:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789778304.947809:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314918528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778304.947841:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314918528:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778304.947857:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789778304.947883:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314918784 00000100:00100000:1.0:1789778304.947887:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314918784 00000100:00100000:1.0:1789778304.947916:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789778304.947923:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314918784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778304.947968:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314918784:12345-0@lo:400:kworker.0 Request processed in 45us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778304.947973:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789778304.948005:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314918272:0@lo:400:kworker.0 00000100:00100000:1.0:1789778304.948016:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314918784:0@lo:400:kworker.0 00000100:00100000:0.0:1789778304.948168:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778304.948207:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314918528:0@lo:400:kworker.0 00000100:00080000:2.0:1789778304.948919:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789778304.948937:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789778304.948939:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778304.948956:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314918656 00000100:00100000:2.0:1789778304.948962:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314918656 00000100:00100000:2.0:1789778304.949016:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789778304.949024:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314918656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778304.949093:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314918656:12345-0@lo:400:kworker.0 Request processed in 70us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778304.949099:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789778304.949131:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314918656:0@lo:400:kworker.0 00000100:00080000:3.0:1789778304.949365:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789778305.458890:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360416822240ns, next at 361416820202ns, rc = 0 00000100:00100000:2.0:1789778305.459185:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778305.459209:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314918912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778305.459280:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778305.459350:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314918912 00000100:00100000:2.0:1789778305.459358:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314918912 00000100:00100000:2.0:1789778305.459402:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789778305.459421:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314918912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778305.459454:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778305.459500:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314918912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778305.459507:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789778305.459557:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314918912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789778305.713454:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778305.825028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778305.825089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778305.825120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778305.825142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778305.825169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778305.825198:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036608 00000100:00100000:0.0:1789778305.825208:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036608 00000100:00100000:0.0:1789778305.825261:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036736 00000100:00100000:0.0:1789778305.825265:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036736 00000100:00100000:0.0:1789778305.825289:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1789778305.825299:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718296036608:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778305.825367:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718296036608:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778305.825374:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1789778305.825392:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1789778305.825399:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296036736:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778305.825423:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296036736:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 25us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778305.825429:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1789778305.825447:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036864 00000100:00100000:0.0:1789778305.825450:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036864 00000100:00100000:0.0:1789778305.825476:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036480 00000100:00100000:0.0:1789778305.825479:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036480 00000100:00100000:0.0:1789778305.825496:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:0.0:1789778305.825502:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718296036864:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778305.825538:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2374:x1876718296036864:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 36us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778305.825545:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:0.0:1789778305.825557:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1789778305.825563:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:2374:x1876718296036480:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778305.825585:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:2374:x1876718296036480:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778305.825591:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:3.0:1789778305.826111:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036352 00000100:00100000:3.0:1789778305.826116:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036352 00000100:00100000:3.0:1789778305.826148:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 291 00000100:00100000:3.0:1789778305.826156:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2374:x1876718296036352:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778305.826188:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2374:x1876718296036352:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 33us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778305.826195:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 291 00000100:00080000:3.0:1789778305.826220:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789778305.826225:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778305.826227:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789778306.015772:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1789778306.015785:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000004:00080000:3.0:1789778306.112237:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1789778306.112272:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1789778306.112298:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3ec17779c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789778306.112304:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3eb98d1800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3ec1777c00 00000020:00080000:3.0:1789778306.112307:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3eb98d1400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3ebf473c00 00000001:00080000:3.0:1789778306.112323:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789778306.112338:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789778306.112351:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789778306.112555:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789778306.113181:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789778306.113207:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314919040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789778306.113281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778306.113408:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919040 00000100:00100000:2.0:1789778306.113416:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919040 00000100:00100000:2.0:1789778306.113482:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789778306.113493:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314919040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789778306.113713:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789778306.113717:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789778299 -> 1789778299 00002000:00010000:2.0:1789778306.113720:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789778299 -> 1789778299 00002000:00010000:2.0:1789778306.113722:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789778299 -> 1789778299 00002000:00010000:2.0:1789778306.113724:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789778306.113764:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314919040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (482us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789778306.113770:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789778306.113791:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778306.113815:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789778306.113819:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789778306.114001:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b3ec16fa300 x1876718314919040/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789778322 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789778306.114013:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec16fa300/2, rc 0, transno 4294967313 00000100:00100000:2.0:1789778306.114019:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314919040:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789778306.738245:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778307.745396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778307.745799:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296036992 00000100:00100000:1.0:1789778307.745809:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296036992 00000100:00100000:1.0:1789778307.745914:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:1.0:1789778307.745927:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10262:x1876718296036992:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1789778307.746055:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778307.746530:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10262:x1876718296036992:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 604us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778307.746538:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 135 00000100:00100000:0.0:1789778307.750492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778307.750593:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296037248 00000100:00100000:2.0:1789778307.750604:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296037248 00000100:00100000:2.0:1789778307.750663:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:2.0:1789778307.750673:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:10262:x1876718296037248:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789778307.751549:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:10262:x1876718296037248:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 874us (1063us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789778307.751559:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00010000:00010000:2.0:1789778307.761501:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778308.071416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778308.071525:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296037376 00000100:00100000:1.0:1789778308.071536:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296037376 00000100:00100000:1.0:1789778308.071608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 136 00000100:00100000:1.0:1789778308.071629:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:11069:x1876718296037376:12345-192.168.201.45@tcp:101:lsof.0 00010000:00010000:1.0:1789778308.071647:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778308.071666:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441679 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d2e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778308.071723:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778308.071736:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778308.071748:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778308.071780:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789778308.071783:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778308.071816:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778308.071838:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778308.071867:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778308.071881:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:1.0:1789778308.071884:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778308.071887:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320600, rc 0) 00000100:00080000:2.0:1789778308.071973:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778308.072311:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:11069:x1876718296037376:12345-192.168.201.45@tcp:101:lsof.0 Request processed in 682us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778308.072327:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 136 00010000:00010000:0.0:1789778308.785419:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778308.977710:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789778308.977720:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778308.978339:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789778308.978347:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789778309.810301:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778310.066758:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778310.066783:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314919168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778310.066865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778310.066963:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919168 00000100:00100000:0.0:1789778310.066971:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919168 00000100:00100000:0.0:1789778310.067040:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789778310.067050:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314919168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778310.067104:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778310.067162:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314919168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778310.067182:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789778310.067206:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778310.067239:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314919168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778310.067759:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314919296:0@lo:400:kworker.0 00000100:00100000:2.0:1789778310.067796:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778310.067841:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314919808:0@lo:400:kworker.0 00000100:00100000:2.0:1789778310.067869:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778310.067890:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778310.067896:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314919424:0@lo:400:kworker.0 00000100:00100000:2.0:1789778310.067930:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778310.068130:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314919680:0@lo:400:kworker.0 00000100:00100000:1.0:1789778310.068160:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778310.068188:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789778310.068194:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314919552:0@lo:400:kworker.0 00000100:00100000:1.0:1789778310.068214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778310.068288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919296 00000100:00100000:3.0:1789778310.068294:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919296 00000100:00100000:3.0:1789778310.068337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789778310.068345:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314919296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778310.068405:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314919296:12345-0@lo:400:kworker.0 Request processed in 61us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778310.068412:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789778310.068525:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919808 00000100:00100000:0.0:1789778310.068530:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919808 00000100:00100000:0.0:1789778310.068596:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789778310.068604:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314919808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778310.068638:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314919808:12345-0@lo:400:kworker.0 Request processed in 35us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778310.068645:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789778310.068665:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919424 00000100:00100000:0.0:1789778310.068668:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919424 00000100:00100000:0.0:1789778310.068690:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919680 00000100:00100000:0.0:1789778310.068693:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919680 00000100:00100000:0.0:1789778310.068704:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919552 00000100:00100000:0.0:1789778310.068706:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919552 00000100:00100000:0.0:1789778310.068718:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789778310.068724:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314919424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778310.068754:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314919424:12345-0@lo:400:kworker.0 Request processed in 29us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778310.068760:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789778310.068770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789778310.068776:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314919680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778310.068804:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314919680:12345-0@lo:400:kworker.0 Request processed in 28us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778310.068809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789778310.068827:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789778310.068832:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314919552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778310.068873:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314919552:12345-0@lo:400:kworker.0 Request processed in 40us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778310.068878:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789778310.069330:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314919552:0@lo:400:kworker.0 00000100:00100000:1.0:1789778310.069342:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314919680:0@lo:400:kworker.0 00000100:00080000:3.0:1789778310.069465:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789778310.069470:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778310.069549:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314919424:0@lo:400:kworker.0 00000100:00100000:2.0:1789778310.069572:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314919296:0@lo:400:kworker.0 00000100:00100000:2.0:1789778310.069585:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314919808:0@lo:400:kworker.0 00000100:00100000:2.0:1789778310.579780:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778310.579807:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314919936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778310.579883:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778310.580076:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314919936 00000100:00100000:0.0:1789778310.580085:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314919936 00000100:00100000:0.0:1789778310.580140:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789778310.580150:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314919936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778310.580184:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778310.580239:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314919936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778310.580246:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789778310.580332:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314919936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789778310.838631:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778310.929840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778310.929886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778310.929912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778310.929933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778310.929956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778310.929981:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296037632 00000100:00100000:1.0:1789778310.929991:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296037632 00000100:00100000:1.0:1789778310.930044:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296038016 00000100:00100000:1.0:1789778310.930047:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296038016 00000100:00100000:1.0:1789778310.930090:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:1.0:1789778310.930101:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2373:x1876718296037632:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778310.930180:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2373:x1876718296037632:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778310.930187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:1.0:1789778310.930206:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:1.0:1789778310.930222:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2372:x1876718296038016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778310.930250:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2372:x1876718296038016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778310.930257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:1.0:1789778310.930276:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296037888 00000100:00100000:1.0:1789778310.930280:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296037888 00000100:00100000:1.0:1789778310.930307:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296037760 00000100:00100000:1.0:1789778310.930310:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296037760 00000100:00100000:1.0:1789778310.930331:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:1.0:1789778310.930338:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718296037888:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778310.930364:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2373:x1876718296037888:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778310.930371:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:1.0:1789778310.930382:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:1.0:1789778310.930388:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2372:x1876718296037760:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778310.930410:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2372:x1876718296037760:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778310.930417:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00080000:1.0:1789778310.930436:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789778310.930440:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789778310.930443:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778310.930672:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296037504 00000100:00100000:3.0:1789778310.930678:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296037504 00000100:00100000:3.0:1789778310.930717:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 293 00000100:00100000:3.0:1789778310.930725:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718296037504:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778310.930759:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718296037504:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 35us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778310.930766:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 293 00000001:00080000:1.0:1789778311.133196:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789778311.140664:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789778311.140679:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789778311.140692:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789778311.140699:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:0.0:1789778311.450683:0:12360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:38:30 (1789778310) 00010000:00010000:2.0:1789778311.865996:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778312.401164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778312.401265:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296038272 00000100:00100000:0.0:1789778312.401277:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296038272 00000100:00100000:0.0:1789778312.401350:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:0.0:1789778312.401360:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:11334:x1876718296038272:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778312.401381:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778312.401401:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441687 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d35 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401475:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401490:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401542:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401560:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401567:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401573:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401891:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c115744169c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401901:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c115744169c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.401922:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c115744169c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778312.401931:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789778312.402217:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402226:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402233:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402239:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778312.402250:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402258:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402270:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3e91b87c00) 00010000:00010000:0.0:1789778312.402273:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778312.402277:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402283:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c115744168e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402295:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402300:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402306:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402311:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778312.402314:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402319:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402325:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b3ea4c7a400) 00010000:00010000:0.0:1789778312.402327:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778312.402333:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.402340:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441695 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789778312.403250:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789778312.403424:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441687 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d35 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.403444:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c115744169c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d35 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.403452:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:0.0:1789778312.403455:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778312.403458:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2800, rc 0) 00000100:00100000:0.0:1789778312.403713:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:11334:x1876718296038272:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2351us (2570us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789778312.403721:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 137 00000100:00100000:3.0:1789778312.412026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778312.412106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778312.412117:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296038400 00000100:00100000:1.0:1789778312.412128:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296038400 00000100:00100000:1.0:1789778312.412191:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 138 00000100:00100000:1.0:1789778312.412201:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:11334:x1876718296038400:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789778312.412305:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:11334:x1876718296038400:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778312.412312:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 138 00000100:00100000:0.0:1789778312.412658:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296038528 00000100:00100000:0.0:1789778312.412663:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296038528 00000100:00100000:0.0:1789778312.412705:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1789778312.412713:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:2373:x1876718296038528:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778312.412724:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778312.412749:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c115744169c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d35 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778312.412768:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:0.0:1789778312.412773:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778312.412813:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2373:x1876718296038528:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 101us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778312.412820:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00010000:00010000:1.0:1789778312.881425:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789778313.077673:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789778313.077682:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789778313.077722:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1789778313.077726:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789778313.800507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778313.801112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296038656 00000100:00100000:1.0:1789778313.801124:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296038656 00000100:00100000:1.0:1789778313.801190:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00100000:1.0:1789778313.801202:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:11376:x1876718296038656:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778313.801224:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778313.801247:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c11574416aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d3c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801318:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801332:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801344:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801358:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801376:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801383:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801632:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801640:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801647:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801654:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778313.801658:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801666:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801678:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:1.0:1789778313.801681:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778313.801686:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801692:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c11574416b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801702:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801714:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801720:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801725:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778313.801728:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801734:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801744:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b3e91b87e00) 00010000:00010000:1.0:1789778313.801746:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778313.801748:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801754:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c11574416b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801788:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c11574416aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d3c expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801798:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:1.0:1789778313.801801:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778313.801804:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c11574416aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d3c expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.801813:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321600, rc 0) 00000100:00100000:1.0:1789778313.801897:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:11376:x1876718296038656:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 697us (1422us total) trans 0 rc 301/301 00000100:00100000:1.0:1789778313.801905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 139 00000100:00100000:0.0:1789778313.825858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778313.826440:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296038912 00000100:00100000:2.0:1789778313.826450:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296038912 00000100:00100000:2.0:1789778313.826519:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 140 00000100:00100000:2.0:1789778313.826530:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:11376:x1876718296038912:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:2.0:1789778313.826585:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778313.826613:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b75 expref: 14 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.826632:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778313.826637:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778313.826931:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.826947:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.826957:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.826990:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.827005:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 5 pid: 5847 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778313.827019:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314920064:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778313.827139:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63180 going to sleep for 11 seconds 00000100:00100000:1.0:1789778313.833998:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314920064:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778313.834030:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778313.842048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778313.845178:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296039040 00000100:00100000:3.0:1789778313.845194:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296039040 00010000:00010000:3.0:1789778313.845255:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 6 pid: 5847 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789778313.845371:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778313.845553:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:3.0:1789778313.845567:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2372:x1876718296039040:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778313.845587:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778313.845604:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 6 pid: 5847 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778313.845619:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 6 pid: 5847 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778313.845644:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441680 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d2e expref: 6 pid: 5847 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778313.845658:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:3.0:1789778313.845664:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778313.845673:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778313.845681:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778313.845713:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778313.845855:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718296039040:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 292us (3817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778313.845864:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00010000:00010000:2.0:1789778313.852300:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.852316:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.852346:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.852358:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.852369:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778313.854221:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789778313.854237:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.854247:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.854254:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.854260:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778313.854264:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.854272:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.854298:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778313.854301:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778313.854306:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.854313:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778313.854333:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000438b637d reply state 00000000c6cc871d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778313.854342:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778313.854439:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:11376:x1876718296038912:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 27907us (28589us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789778313.854449:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 140 00010000:00010000:1.0:1789778313.857495:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.857512:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.857520:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.857525:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778313.857531:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.857538:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.857554:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b3e922c1700) 00010000:00010000:1.0:1789778313.857557:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778313.857562:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778313.857567:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574416c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.909355:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778313.986353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778313.986497:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296039168 00000100:00100000:2.0:1789778313.986508:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296039168 00000100:00100000:2.0:1789778313.986614:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:2.0:1789778313.986626:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:11384:x1876718296039168:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:2.0:1789778313.986655:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778313.986678:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d43 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.986751:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c11574416d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.986764:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c11574416d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.986798:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c11574416d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778313.986830:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778313.986833:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778313.986849:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c11574416d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.986870:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574416cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d43 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.986887:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c11574416d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d43 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778313.986895:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778313.986898:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778313.986901:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9a00, rc 0) 00000100:00100000:2.0:1789778313.986959:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:11384:x1876718296039168:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 336us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778313.986965:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 141 00000100:00100000:2.0:1789778314.049728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778314.050274:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296039296 00000100:00100000:0.0:1789778314.050285:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296039296 00000100:00100000:0.0:1789778314.050371:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:0.0:1789778314.050382:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+15:11390:x1876718296039296:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778314.050404:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778314.050427:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574416db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d4a expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050510:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050526:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050548:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789778314.050553:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789778314.050563:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050570:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050577:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050679:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574416f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050698:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574416f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050706:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574416f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778314.050731:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789778314.050735:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778314.050753:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574416f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050765:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050771:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050778:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050783:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778314.050787:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.050793:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051028:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:0.0:1789778314.051032:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778314.051037:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051053:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574416e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051107:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051114:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051121:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051126:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778314.051129:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051135:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051144:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b3ea4c7a700) 00010000:00010000:0.0:1789778314.051147:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778314.051149:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051154:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051186:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574416db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d4a expref: 17 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051200:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574416f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d4a expref: 16 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.051213:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778314.051215:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789778314.051217:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3000, rc 0) 00000100:00100000:1.0:1789778314.051366:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:11390:x1876718296039296:12345-192.168.201.45@tcp:101:bash.0 Request processed in 984us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778314.051374:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 142 00000100:00100000:1.0:1789778314.065563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778314.065640:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296039552 00000100:00100000:0.0:1789778314.065650:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296039552 00000100:00100000:0.0:1789778314.065715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 143 00000100:00100000:0.0:1789778314.065725:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+16:11390:x1876718296039552:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778314.065744:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778314.065766:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574416f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d51 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.065886:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.065902:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.065913:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.065971:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.065981:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.065988:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789778314.066614:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789778314.066773:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066783:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066792:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066823:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066831:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066837:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066843:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778314.066848:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066855:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066868:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778314.066871:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778314.066875:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066893:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c11574416fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789778314.066908:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9ad4b8a reply state 00000000227529b4 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778314.066917:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789778314.066949:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574416f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066965:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.066973:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:0.0:1789778314.066975:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778314.066977:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2c00, rc 0) 00000100:00100000:0.0:1789778314.067052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11390:x1876718296039552:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1328us (1499us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789778314.067061:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 143 00010000:00010000:1.0:1789778314.070591:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.070610:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.070618:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.070625:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778314.070631:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.070639:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.070660:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3ea4c7a700) 00010000:00010000:1.0:1789778314.070663:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778314.070668:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.070676:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441705 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778314.070752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.070937:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296039680 00000100:00100000:2.0:1789778314.070947:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296039680 00000100:00100000:2.0:1789778314.071016:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:2.0:1789778314.071028:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2374:x1876718296039680:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778314.071044:0:8205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.071085:0:8205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d58 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778314.071122:0:8205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778314.071141:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1789778314.071145:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778314.071154:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 6 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.071174:0:8205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 6 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.071187:0:8205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9400, rc 0) 00000100:00100000:2.0:1789778314.071236:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718296039680:12345-192.168.201.45@tcp:101:bash.0 Request processed in 212us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.071243:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00080000:3.0:1789778314.071351:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778314.075588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778314.075677:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296039808 00000100:00100000:1.0:1789778314.075690:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296039808 00000100:00100000:1.0:1789778314.075742:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:1.0:1789778314.075752:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:11390:x1876718296039808:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1789778314.075780:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778314.075799:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d5f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.075833:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 7 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.075843:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778314.075848:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778314.075853:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.075887:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 7 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.075901:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 7 pid: 8205 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778314.075916:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876718314920192:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778314.076009:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789778314.080961:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876718314920192:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778314.081014:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.081036:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321400, rc 0) 00000100:00100000:1.0:1789778314.081114:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:11390:x1876718296039808:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5362us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778314.081123:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:0.0:1789778314.085759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.085886:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296039936 00000100:00100000:2.0:1789778314.085896:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296039936 00010000:00010000:2.0:1789778314.085937:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 7 pid: 8205 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.085983:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1789778314.085994:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296039936:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778314.086008:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778314.086028:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 7 pid: 8205 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.086096:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 7 pid: 8205 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.086120:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744171a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d58 expref: 7 pid: 8205 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.086135:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778314.086140:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778314.086147:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.086157:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.086196:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.086210:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1876718314920320:192.168.201.45@tcp:105: 00000100:00100000:2.0:1789778314.086279:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63300 going to sleep for 11 seconds 00000100:00100000:0.0:1789778314.100934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778314.101161:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296040192 00000100:00100000:3.0:1789778314.101172:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296040192 00000100:00100000:3.0:1789778314.101232:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:3.0:1789778314.101243:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:11390:x1876718296040192:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:2.0:1789778314.101546:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1876718314920320:192.168.201.45@tcp:105: 00010000:00010000:2.0:1789778314.101570:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778314.101592:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11390:x1876718296040192:12345-192.168.201.45@tcp:35:bash.0 Request processed in 350us (667us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789778314.101599:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296039936:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 15607us (15850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.101611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:3.0:1789778314.101616:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:0.0:1789778314.223939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.224021:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296040448 00000100:00100000:2.0:1789778314.224029:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296040448 00000100:00100000:2.0:1789778314.224095:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:2.0:1789778314.224103:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11400:x1876718296040448:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778314.224136:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.224156:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d66 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778314.224246:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789778314.224342:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441728 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d66 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.224353:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778314.224356:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778314.224359:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d66 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.224368:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9400, rc 0) 00000100:00100000:2.0:1789778314.224417:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11400:x1876718296040448:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 315us (488us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789778314.224422:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 144 00000100:00100000:1.0:1789778314.227939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778314.228402:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296040704 00000100:00100000:3.0:1789778314.228431:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296040704 00000100:00100000:3.0:1789778314.228629:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:3.0:1789778314.228655:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11400:x1876718296040704:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778314.229020:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11400:x1876718296040704:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 375us (1091us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789778314.229029:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:1.0:1789778314.283168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778314.283320:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296040832 00000100:00100000:0.0:1789778314.283330:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296040832 00000100:00100000:0.0:1789778314.283390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:0.0:1789778314.283409:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11406:x1876718296040832:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778314.283445:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778314.283496:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.283628:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744173d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.283644:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744173d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.283656:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744173d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778314.283693:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789778314.283698:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778314.283716:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744173d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.283742:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d6d expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.283855:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744173d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d6d expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.283864:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778314.283867:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778314.283870:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3200, rc 0) 00000100:00100000:0.0:1789778314.283929:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:11406:x1876718296040832:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 529us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778314.283940:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 145 00000100:00100000:1.0:1789778314.294750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.295197:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296041088 00000100:00100000:2.0:1789778314.295219:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296041088 00000100:00100000:2.0:1789778314.295285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:2.0:1789778314.295296:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:11406:x1876718296041088:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778314.295316:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.295335:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d74 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.295471:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c115744174b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.295485:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c115744174b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.295497:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c115744174b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778314.295507:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789778314.295645:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d74 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.295664:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c115744174b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d74 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.295674:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:2.0:1789778314.295676:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778314.295680:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8e00, rc 0) 00000100:00100000:2.0:1789778314.295747:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11406:x1876718296041088:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 453us (1007us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789778314.295755:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 146 00000100:00100000:1.0:1789778314.299645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778314.299689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.299772:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296041344 00000100:00100000:2.0:1789778314.299783:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296041344 00000100:00100000:2.0:1789778314.299840:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:2.0:1789778314.299851:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11406:x1876718296041344:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778314.299874:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.299909:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441759 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d7b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.300011:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441760 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.300026:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.300039:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778314.300052:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789778314.300216:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441759 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d7b expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.300236:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d7b expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.300245:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:2.0:1789778314.300248:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789778314.300256:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8200, rc 0) 00000100:00100000:2.0:1789778314.300315:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11406:x1876718296041344:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 465us (680us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789778314.300322:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 147 00000100:00100000:0.0:1789778314.300576:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296041472 00000100:00100000:0.0:1789778314.300582:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296041472 00000100:00100000:0.0:1789778314.300626:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1789778314.300634:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:2375:x1876718296041472:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778314.300645:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778314.300661:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c115744174b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d74 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.300673:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:0.0:1789778314.300676:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778314.300698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+25:2375:x1876718296041472:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 65us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778314.300704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1789778314.311917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.311995:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296041600 00000100:00100000:2.0:1789778314.312005:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296041600 00000100:00100000:2.0:1789778314.312098:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:2.0:1789778314.312109:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2374:x1876718296041600:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:2.0:1789778314.312164:0:8205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.312184:0:8205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.312192:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778314.312196:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778314.312200:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.312244:0:8205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.312258:0:8205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 6 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.312272:0:8205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314920448:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778314.312352:0:8205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63300 going to sleep for 11 seconds 00000100:00100000:2.0:1789778314.314989:0:8205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314920448:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778314.315020:0:8205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778314.317712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.318034:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296041728 00000100:00100000:2.0:1789778314.318043:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296041728 00002000:00100000:2.0:1789778314.318141:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b3eb5855500 x1876718296041728/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:240/0 lens 504/0 e 0 to 0 dl 1789778325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789778314.318166:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3eb5855500 with x1876718296041728 ext(0->12) 00010000:00010000:2.0:1789778314.318176:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 7 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.318193:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 7 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778314.318201:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3eb5855500 00000100:00100000:2.0:1789778314.318238:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1789778314.318247:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296041728:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:2.0:1789778314.321896:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2374:x1876718296041728:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 3289us (3830us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789778314.321918:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00002000:00100000:2.0:1789778314.321933:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b3eb5855500 x1876718296041728/t4294967305(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:240/0 lens 504/448 e 0 to 0 dl 1789778325 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789778314.321944:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3eb5855500 with x1876718296041728 ext(0->12) 00010000:00010000:2.0:1789778314.321955:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 9 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.321973:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 9 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778314.321981:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3eb5855500 00000100:00100000:1.0:1789778314.331112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.331534:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296041856 00000100:00100000:2.0:1789778314.331557:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296041856 00010000:00010000:2.0:1789778314.331600:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 9 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.331724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1789778314.331735:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2373:x1876718296041856:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778314.331752:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789778314.331771:0:5833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789778314.331774:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789778314 00002000:00010000:2.0:1789778314.331776:0:5833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789778314 00002000:00010000:2.0:1789778314.331778:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789778314 00010000:00010000:2.0:1789778314.331785:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 9 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.331799:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 9 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.331821:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef75d6f/0x5a1e1c1157441721 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d5f expref: 9 pid: 6693 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.331838:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778314.331843:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778314.331849:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.331858:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.331912:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778314.331973:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2373:x1876718296041856:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 239us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.331980:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00010000:00010000:1.0:1789778314.332037:0:8205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332047:0:8205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332089:0:8205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332099:0:8205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332107:0:8205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332120:0:8205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778314.332125:0:8205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332133:0:8205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332148:0:8205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.332156:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095d3564c/0x5a1e1c115744176e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778314.332200:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296041600:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 20094us (20305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778314.332221:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:1.0:1789778314.340300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778314.340653:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296042112 00000100:00100000:0.0:1789778314.340665:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296042112 00000100:00100000:0.0:1789778314.340725:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:0.0:1789778314.340735:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86775c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+25:11406:x1876718296042112:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:0.0:1789778314.340800:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d7b expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789778314.341048:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789778314.341124:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789778314.344944:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789778314.346117:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.346157:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.346167:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.347320:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778314.347344:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 29 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778314.347360:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314920576:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778314.347471:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777840 going to sleep for 11 seconds 00000100:00100000:3.0:1789778314.351686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778314.352400:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314920576:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778314.352428:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.353673:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296042240 00000100:00100000:2.0:1789778314.353686:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296042240 00010000:00010000:2.0:1789778314.353729:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.353776:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:2.0:1789778314.353787:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+30:2375:x1876718296042240:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778314.353803:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778314.353809:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.353823:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.353847:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c115744170c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d51 expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.353865:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:2.0:1789778314.353870:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.353878:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.353898:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.353947:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778314.354011:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:2375:x1876718296042240:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 227us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.354019:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00010000:00010000:1.0:1789778314.354161:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.354170:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789778314.354289:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789778314.354483:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789778314.354590:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314920704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789778314.354645:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778314.354682:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789778314.356600:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314920704 00000100:00100000:3.0:1789778314.356613:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314920704 00000100:00100000:3.0:1789778314.356700:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778314.356711:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314920704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789778314.356830:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314920704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 121us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778314.356838:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789778314.356987:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778314.357027:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314920704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789778314.357583:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789778314.357663:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314920832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789778314.357704:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778314.357734:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e904a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778314.358251:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314920832 00000100:00100000:3.0:1789778314.358258:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314920832 00000100:00100000:3.0:1789778314.358298:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789778314.358306:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876718314920832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789778314.358479:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876718314920832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 173us (774us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789778314.358487:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789778314.359373:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfb67480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314920832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789778314.359442:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789778314.359501:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.359512:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.359519:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.359525:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778314.359530:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.359537:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.359553:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:1.0:1789778314.359556:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789778314.359562:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.359580:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441775 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789778314.359799:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789778314.359892:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789778314.359901:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369317835633ns, next at 370317834010ns, rc = 0 00000001:00080000:1.0:1789778314.359907:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789778314.359936:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:1.0:1789778314.359939:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789778314.359946:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441760 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d7b expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778314.360039:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86775c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:11406:x1876718296042112:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 19305us (19754us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789778314.360048:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00000020:00080000:1.0:1789778314.360053:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789778314.365048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.365310:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296042368 00000100:00100000:2.0:1789778314.365320:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296042368 00000100:00100000:2.0:1789778314.365381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 148 00000100:00100000:2.0:1789778314.365391:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:11406:x1876718296042368:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778314.365413:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.365434:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c115744177c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d82 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.365506:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c115744177c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d82 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.365521:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c115744177c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d82 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.365540:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778314.365543:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789778314.365546:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8400, rc 0) 00000100:00100000:2.0:1789778314.365611:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:11406:x1876718296042368:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 222us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.365618:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 148 00000100:00100000:2.0:1789778314.375311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778314.375441:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296042624 00000100:00100000:3.0:1789778314.375452:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296042624 00000100:00100000:3.0:1789778314.375535:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:3.0:1789778314.375545:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:11406:x1876718296042624:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778314.375791:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:11406:x1876718296042624:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 246us (489us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789778314.375799:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:3.0:1789778314.476334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.476582:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296042880 00000100:00100000:2.0:1789778314.476593:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296042880 00000100:00100000:2.0:1789778314.476665:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:2.0:1789778314.476677:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:11415:x1876718296042880:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778314.476703:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.476730:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d89 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778314.476841:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789778314.476974:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441783 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d89 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.476988:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778314.476991:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778314.476995:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d89 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.477009:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9600, rc 0) 00000100:00100000:2.0:1789778314.477127:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:11415:x1876718296042880:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 452us (803us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789778314.477135:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 149 00000100:00100000:0.0:1789778314.482516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.482595:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296043008 00000100:00100000:2.0:1789778314.482606:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296043008 00000100:00100000:2.0:1789778314.482670:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:2.0:1789778314.482679:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:11415:x1876718296043008:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1789778314.482754:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482795:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482808:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482824:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482831:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482838:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482922:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482931:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482938:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778314.482978:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482991:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.482997:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483016:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483021:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778314.483025:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483033:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483045:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778314.483048:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778314.483052:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483058:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441791 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483097:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483103:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483108:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483114:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778314.483117:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483132:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483147:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778314.483149:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778314.483152:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483158:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483170:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483176:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483181:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483187:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778314.483189:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483195:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483201:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778314.483204:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778314.483206:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.483222:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c115744179f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.483294:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:11415:x1876718296043008:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 615us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.483303:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 150 00000100:00100000:1.0:1789778314.494606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778314.494691:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296043264 00000100:00100000:3.0:1789778314.494702:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296043264 00000100:00100000:3.0:1789778314.494756:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1789778314.494859:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:11415:x1876718296043264:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:3.0:1789778314.495139:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:11415:x1876718296043264:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 275us (538us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789778314.499011:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1789778314.560196:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.560298:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296043520 00000100:00100000:2.0:1789778314.560309:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296043520 00000100:00100000:2.0:1789778314.560368:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:2.0:1789778314.560379:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:11419:x1876718296043520:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778314.560401:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.560422:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d90 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560509:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560522:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560534:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560548:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560555:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560581:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560690:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560698:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560705:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778314.560714:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789778314.560818:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560824:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560830:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560836:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778314.560841:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560847:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560858:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778314.560861:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778314.560872:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560879:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c11574417ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560891:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560896:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560901:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560906:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778314.560909:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560914:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560922:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778314.560925:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778314.560927:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560932:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560970:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.560995:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.561002:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778314.561004:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778314.561007:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8a00, rc 0) 00000100:00100000:2.0:1789778314.561884:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:11419:x1876718296043520:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1502us (1693us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789778314.561895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:0.0:1789778314.566126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.566253:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296043648 00000100:00100000:2.0:1789778314.566263:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296043648 00000100:00100000:2.0:1789778314.566313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:2.0:1789778314.566322:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:11419:x1876718296043648:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1789778314.566386:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566402:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566414:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566440:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566447:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566484:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566490:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778314.566494:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566501:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566513:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778314.566516:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778314.566520:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.566526:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.566597:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:11419:x1876718296043648:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 275us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.566604:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 152 00000100:00100000:3.0:1789778314.569540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.569975:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296043904 00000100:00100000:2.0:1789778314.569987:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296043904 00000100:00100000:2.0:1789778314.570114:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:2.0:1789778314.570125:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:11419:x1876718296043904:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778314.570355:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:11419:x1876718296043904:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 231us (826us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789778314.570363:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000001:00080000:2.0:1789778314.775037:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789778314.775102:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1789778314.915983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778314.916376:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296044160 00000100:00100000:0.0:1789778314.916387:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296044160 00000100:00100000:1.0:1789778314.916719:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00100000:1.0:1789778314.916731:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:11450:x1876718296044160:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:1.0:1789778314.916766:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778314.916790:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c11574417d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.916884:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c11574417d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.916924:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c11574417d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.916936:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c11574417d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778314.916949:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789778314.923573:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c11574417d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d97 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.923606:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c11574417d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d97 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778314.923617:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:1.0:1789778314.923620:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778314.923625:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320800, rc 0) 00000100:00100000:1.0:1789778314.923702:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:11450:x1876718296044160:12345-192.168.201.45@tcp:101:cat.0 Request processed in 6973us (7728us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789778314.923709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 153 00000100:00100000:0.0:1789778314.928569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778314.928857:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296044416 00000100:00100000:3.0:1789778314.928867:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296044416 00000100:00100000:3.0:1789778314.928921:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:3.0:1789778314.928934:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:11450:x1876718296044416:12345-192.168.201.45@tcp:35:cat.0 00010000:00010000:1.0:1789778314.929384:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778314.932870:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+42:11450:x1876718296044416:12345-192.168.201.45@tcp:35:cat.0 Request processed in 3919us (4289us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789778314.932902:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:0.0:1789778314.933709:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.933841:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296044544 00000100:00100000:2.0:1789778314.933851:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296044544 00000100:00100000:2.0:1789778314.933919:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1789778314.933930:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+42:2375:x1876718296044544:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778314.933944:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778314.933967:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c11574417d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d97 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.933985:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778314.933990:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778314.934035:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:2375:x1876718296044544:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778314.934042:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:0.0:1789778314.992380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778314.992440:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296044800 00000100:00100000:2.0:1789778314.992467:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296044800 00000100:00100000:2.0:1789778314.992588:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00100000:2.0:1789778314.992600:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:11456:x1876718296044800:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:2.0:1789778314.992624:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778314.992628:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789778314.992653:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744173d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d6d expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.992675:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778314.992680:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778314.992695:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7d9e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.992816:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.992829:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.992837:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.992869:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778314.992883:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 41 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778314.992896:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314920960:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778314.992987:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778315.006405:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314920960:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778315.006438:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778315.006498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778315.006812:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296044928 00000100:00100000:0.0:1789778315.006818:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296044928 00010000:00010000:0.0:1789778315.006865:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 42 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778315.006895:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1789778315.006905:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+42:2374:x1876718296044928:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778315.006920:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778315.006927:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 42 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.006938:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 42 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.006955:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574417bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d90 expref: 42 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.006966:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:0.0:1789778315.006970:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.006976:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.006982:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.007000:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778315.007022:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.007029:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778315.007047:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:0.0:1789778315.007059:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:2374:x1876718296044928:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 156us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778315.007105:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00010000:00010000:2.0:1789778315.007405:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574417e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.007420:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.007428:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.007431:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789778315.007433:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8600, rc 0) 00000100:00100000:2.0:1789778315.007490:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:11456:x1876718296044800:12345-192.168.201.45@tcp:101:dd.0 Request processed in 14893us (15118us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789778315.007497:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 154 00000100:00100000:1.0:1789778315.012010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.012258:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296045184 00000100:00100000:2.0:1789778315.012275:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296045184 00000100:00100000:2.0:1789778315.012326:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:2.0:1789778315.012335:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+41:11456:x1876718296045184:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:2.0:1789778315.012593:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.012610:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.012621:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789778315.012665:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789778315.012688:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006492d092 reply state 00000000d761abfb transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778315.012696:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778315.012937:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+44:11456:x1876718296045184:12345-192.168.201.45@tcp:36:dd.0 Request processed in 602us (940us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789778315.012945:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 155 00000020:00080000:2.0:1789778315.012951:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789778315.024899:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.024918:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.024926:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.024946:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778315.024952:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.024960:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.024977:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:1.0:1789778315.024981:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778315.024986:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.024993:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c11574417fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778315.186533:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314921344:0@lo:400:kworker.0 00000100:00100000:0.0:1789778315.186614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778315.186686:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778315.186693:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314921472:0@lo:400:kworker.0 00000100:00100000:0.0:1789778315.186721:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778315.186764:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314921472 00000100:00100000:0.0:1789778315.186772:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314921472 00000100:00100000:0.0:1789778315.186824:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789778315.186833:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314921472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778315.186882:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314921472:12345-0@lo:400:kworker.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778315.186889:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789778315.186914:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314921344 00000100:00100000:0.0:1789778315.186917:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314921344 00000100:00100000:0.0:1789778315.186952:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789778315.186959:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314921344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778315.186987:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314921344:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778315.186992:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1789778315.187008:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778315.187030:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789778315.187035:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789778315.187056:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314921472:0@lo:400:kworker.0 00000100:00100000:0.0:1789778315.187090:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314921344:0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187232:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314921216:0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778315.187279:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314921728:0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187300:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778315.187316:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789778315.187322:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314921088:0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778315.187369:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314921600:0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187388:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778315.187407:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314921216 00000100:00100000:2.0:1789778315.187411:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314921216 00000100:00100000:2.0:1789778315.187430:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314921600 00000100:00100000:2.0:1789778315.187433:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314921600 00000100:00100000:2.0:1789778315.187467:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789778315.187474:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314921216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187508:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314921216:12345-0@lo:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.187514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789778315.187526:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789778315.187531:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314921600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187555:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314921600:12345-0@lo:400:kworker.0 Request processed in 24us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.187560:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789778315.187600:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314921600:0@lo:400:kworker.0 00000100:00100000:2.0:1789778315.187609:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314921216:0@lo:400:kworker.0 00000100:00100000:1.0:1789778315.187744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314921088 00000100:00100000:1.0:1789778315.187748:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314921088 00000100:00100000:1.0:1789778315.187787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789778315.187795:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314921088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778315.187833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314921088:12345-0@lo:400:kworker.0 Request processed in 40us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778315.187839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789778315.187868:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314921088:0@lo:400:kworker.0 00000100:00100000:1.0:1789778315.188043:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314921856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778315.188103:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778315.188262:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314921856 00000100:00100000:2.0:1789778315.188266:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314921856 00000100:00100000:2.0:1789778315.188301:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789778315.188308:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314921856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778315.188322:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789778315.188359:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314921856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.188365:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789778315.188692:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314921856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789778315.188945:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778315.188960:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314921728 00000100:00100000:0.0:1789778315.188973:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314921728 00000100:00100000:0.0:1789778315.189021:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789778315.189030:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314921728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778315.189119:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314921728:12345-0@lo:400:kworker.0 Request processed in 90us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778315.189125:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789778315.189297:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789778315.189304:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec16fa300, transno 4294967313 00000100:00100000:3.0:1789778315.189323:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314921728:0@lo:400:kworker.0 00000100:00080000:2.0:1789778315.189720:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778315.233110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.233236:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296045312 00000100:00100000:2.0:1789778315.233247:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296045312 00000100:00100000:2.0:1789778315.233586:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:2.0:1789778315.233597:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+43:11470:x1876718296045312:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:2.0:1789778315.233621:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.233642:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441801 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7da5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233700:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233713:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233726:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233810:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233818:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233824:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233903:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233914:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233921:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233951:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.233964:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 44 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778315.233976:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314921984:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778315.234146:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789778315.237599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778315.237697:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296045568 00000100:00100000:1.0:1789778315.237707:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296045568 00000100:00100000:1.0:1789778315.237769:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:1.0:1789778315.237778:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+45:5626:x1876718296045568:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789778315.238106:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:5626:x1876718296045568:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 329us (518us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789778315.238113:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:2.0:1789778315.239016:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314921984:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778315.239043:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778315.241018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778315.241106:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296045696 00000100:00100000:3.0:1789778315.241116:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296045696 00010000:00010000:3.0:1789778315.241159:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 46 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778315.241194:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:3.0:1789778315.241203:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:2374:x1876718296045696:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778315.241216:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778315.241223:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 46 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.241236:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 46 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.241266:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574417ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d9e expref: 46 pid: 5847 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.241283:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:3.0:1789778315.241289:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.241299:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.241307:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.241344:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778315.241398:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+45:2374:x1876718296045696:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 196us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778315.241416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00010000:00010000:0.0:1789778315.241522:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241530:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778315.241575:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789778315.241579:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778315.241598:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241610:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241620:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241627:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241634:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241640:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778315.241650:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241659:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241669:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778315.241672:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778315.241676:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241682:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441808 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241692:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241698:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241703:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241709:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778315.241712:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241717:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241723:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1700) 00010000:00010000:0.0:1789778315.241725:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778315.241732:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241738:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c115744180f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241781:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441801 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7da5 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241794:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7da5 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.241801:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:0.0:1789778315.241804:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778315.241806:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9600, rc 0) 00000100:00100000:0.0:1789778315.241830:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+44:11470:x1876718296045312:12345-192.168.201.45@tcp:101:stat.0 Request processed in 8236us (8734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778315.241836:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:0.0:1789778315.275109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.275210:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296045952 00000100:00100000:2.0:1789778315.275219:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296045952 00000100:00100000:2.0:1789778315.275268:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 157 00000100:00100000:2.0:1789778315.275275:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+44:11476:x1876718296045952:12345-192.168.201.45@tcp:36:truncate.0 00010000:00010000:2.0:1789778315.275326:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778315.275360:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7da5 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.275375:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.275379:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778315.275589:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.275604:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.275615:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789778315.275671:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789778315.275693:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061345015 reply state 00000000897298a7 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778315.275707:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778315.276002:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:11476:x1876718296045952:12345-192.168.201.45@tcp:36:truncate.0 Request processed in 724us (937us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789778315.276010:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 157 00000020:00080000:2.0:1789778315.276014:0:8093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789778315.278373:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.278389:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.278398:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.278404:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778315.278409:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.278417:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.278431:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:3.0:1789778315.278433:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778315.278437:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.278443:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c115744181d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778315.364813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778315.364868:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296046080 00000100:00100000:1.0:1789778315.364880:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296046080 00000100:00100000:1.0:1789778315.364935:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 158 00000100:00100000:1.0:1789778315.364945:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+45:11490:x1876718296046080:12345-192.168.201.45@tcp:101:stat.0 00010000:00010000:1.0:1789778315.364972:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778315.364994:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441824 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7dac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365059:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365109:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365119:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365132:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365140:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365166:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365267:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365276:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365282:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778315.365315:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789778315.365319:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778315.365340:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365351:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365357:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365362:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365366:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365369:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778315.365372:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365382:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365391:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:1.0:1789778315.365393:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778315.365396:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365400:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c115744182b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365409:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365412:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365416:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365419:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778315.365420:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365424:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365427:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e91b87e00) 00010000:00010000:1.0:1789778315.365428:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778315.365430:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365441:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365482:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441824 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365493:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.365501:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:1.0:1789778315.365503:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778315.365505:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321a00, rc 0) 00000100:00100000:1.0:1789778315.365570:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:11490:x1876718296046080:12345-192.168.201.45@tcp:101:stat.0 Request processed in 625us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778315.365577:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 158 00000100:00100000:1.0:1789778315.422533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.422642:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296046336 00000100:00100000:2.0:1789778315.422654:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296046336 00000100:00100000:2.0:1789778315.422724:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 159 00000100:00100000:2.0:1789778315.422735:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+46:11500:x1876718296046336:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778315.422767:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.422791:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7db3 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778315.422883:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789778315.423090:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441840 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7db3 expref: 48 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.423106:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778315.423110:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778315.423115:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7db3 expref: 48 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.423130:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9600, rc 0) 00000100:00100000:2.0:1789778315.423208:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:11500:x1876718296046336:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 474us (695us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1789778315.423215:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 159 00000100:00100000:0.0:1789778315.425821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778315.425873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296046592 00000100:00100000:1.0:1789778315.425882:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296046592 00000100:00100000:1.0:1789778315.425938:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1789778315.425949:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86775450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:11500:x1876718296046592:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:1.0:1789778315.426233:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86775450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:11500:x1876718296046592:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 285us (419us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789778315.426241:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1789778315.472863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778315.472982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296046848 00000100:00100000:0.0:1789778315.472994:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296046848 00000100:00100000:0.0:1789778315.473230:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:0.0:1789778315.473244:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:11506:x1876718296046848:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778315.473269:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778315.473288:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c115744184e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7dba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.473396:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.473411:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.473419:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.473465:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.473638:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 49 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778315.473653:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314922112:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778315.473780:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777840 going to sleep for 11 seconds 00000100:00100000:2.0:1789778315.477108:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314922112:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778315.477151:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778315.477175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778315.477311:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296046976 00000100:00100000:0.0:1789778315.477319:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296046976 00010000:00010000:0.0:1789778315.477357:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 50 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778315.477401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1789778315.477409:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789778315.477409:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:2375:x1876718296046976:12345-192.168.201.45@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789778315.477419:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789778315.477424:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778315.477430:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 50 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.477472:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 50 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.477604:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441839 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dac expref: 50 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.477618:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:0.0:1789778315.477622:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.477632:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.477639:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778315.477717:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778315.477769:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:2375:x1876718296046976:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 360us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778315.477778:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00010000:00010000:3.0:1789778315.480321:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.480338:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778315.480374:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789778315.480766:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c115744184e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.480799:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.480808:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.480811:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789778315.480814:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2200, rc 0) 00000100:00100000:2.0:1789778315.480896:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:11506:x1876718296046848:12345-192.168.201.45@tcp:101:bash.0 Request processed in 7655us (8043us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789778315.480904:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:1.0:1789778315.493508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.493605:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296047232 00000100:00100000:2.0:1789778315.493617:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296047232 00000100:00100000:2.0:1789778315.493671:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:2.0:1789778315.493680:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+49:11506:x1876718296047232:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:2.0:1789778315.493942:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.493961:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.493974:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789778315.494029:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1789778315.494053:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001964b23f reply state 000000006f0c7013 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778315.494062:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778315.494192:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:11506:x1876718296047232:12345-192.168.201.45@tcp:36:bash.0 Request processed in 512us (693us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789778315.494199:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 161 00000020:00080000:2.0:1789778315.494204:0:8093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789778315.496916:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.496933:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.496940:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.496946:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778315.496951:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.496959:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.496975:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:1.0:1789778315.496977:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778315.496982:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.496987:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441863 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778315.505178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.505318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296047360 00000100:00100000:2.0:1789778315.505329:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296047360 00000100:00100000:2.0:1789778315.505432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:2.0:1789778315.505453:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:11506:x1876718296047360:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778315.505502:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.505525:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c115744186a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7dc1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.505604:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.505620:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.505627:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.505660:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.505672:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 52 pid: 5845 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778315.505686:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314922240:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778315.505771:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63480 going to sleep for 11 seconds 00000100:00100000:2.0:1789778315.514910:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314922240:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778315.514941:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778315.515293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.515355:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296047488 00000100:00100000:2.0:1789778315.515361:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296047488 00010000:00010000:2.0:1789778315.515391:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 53 pid: 5845 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778315.515420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:2.0:1789778315.515426:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:2375:x1876718296047488:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778315.515437:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778315.515457:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 53 pid: 5845 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.515469:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 53 pid: 5845 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.515508:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c1157441855 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dba expref: 53 pid: 5845 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.515525:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.515530:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.515540:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.515548:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.515591:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778315.515658:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:2375:x1876718296047488:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 230us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.515665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00010000:00010000:1.0:1789778315.515904:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.515912:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778315.515954:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789778315.515965:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778315.515987:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.516016:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c115744186a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dc1 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.516030:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dc1 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.516038:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:1.0:1789778315.516041:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778315.516043:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9400, rc 0) 00000100:00100000:1.0:1789778315.516126:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:11506:x1876718296047360:12345-192.168.201.45@tcp:101:bash.0 Request processed in 10685us (10955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778315.516133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 162 00000100:00100000:0.0:1789778315.522615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778315.525837:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296047744 00000100:00100000:3.0:1789778315.525856:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296047744 00000100:00100000:3.0:1789778315.525986:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:3.0:1789778315.525996:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:11506:x1876718296047744:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:3.0:1789778315.526711:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:11506:x1876718296047744:12345-192.168.201.45@tcp:35:bash.0 Request processed in 713us (4102us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789778315.526720:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:0.0:1789778315.647204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.647339:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296048000 00000100:00100000:2.0:1789778315.647350:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296048000 00000100:00100000:2.0:1789778315.647410:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:2.0:1789778315.647420:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:11516:x1876718296048000:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778315.647472:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.647495:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7dc8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778315.647591:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789778315.647714:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441878 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dc8 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.647730:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778315.647733:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778315.647739:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dc8 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.647763:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8e00, rc 0) 00000100:00100000:2.0:1789778315.647827:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:11516:x1876718296048000:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 408us (636us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789778315.647835:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 163 00000100:00100000:0.0:1789778315.652906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.653027:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296048128 00000100:00100000:2.0:1789778315.653050:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296048128 00000100:00100000:2.0:1789778315.653372:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:2.0:1789778315.653383:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:11516:x1876718296048128:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1789778315.653471:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653489:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653501:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653517:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653525:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653532:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653626:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653635:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653641:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778315.653680:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653706:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653714:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653722:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.653727:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778315.653731:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654153:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654167:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778315.654169:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778315.654174:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654180:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441886 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654191:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654196:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654201:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654212:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778315.654215:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654220:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654226:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778315.654228:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778315.654231:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654236:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c115744188d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654247:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654253:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654257:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654262:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778315.654265:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654270:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654285:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.654287:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778315.654290:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.654295:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441894 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778315.654417:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:11516:x1876718296048128:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1034us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.654425:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 164 00000100:00100000:1.0:1789778315.656717:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.656844:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296048384 00000100:00100000:2.0:1789778315.656853:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296048384 00000100:00100000:2.0:1789778315.656907:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:2.0:1789778315.656917:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+53:11516:x1876718296048384:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778315.657163:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:11516:x1876718296048384:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 247us (454us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789778315.657170:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1789778315.691010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.691119:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296048640 00000100:00100000:2.0:1789778315.691129:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296048640 00000100:00100000:2.0:1789778315.691348:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:2.0:1789778315.691359:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:11519:x1876718296048640:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778315.691384:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.691405:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c115744189b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7dcf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691512:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691533:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691545:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691561:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691568:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691574:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691692:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691701:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691708:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778315.691717:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789778315.691922:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691931:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691938:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691950:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778315.691955:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691963:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691976:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778315.691979:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778315.691984:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.691990:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.692004:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.692009:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.692015:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.692020:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778315.692022:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.692028:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.692047:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778315.692049:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778315.692052:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.692058:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.692608:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c115744189b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dcf expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.692626:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dcf expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778315.692634:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:3.0:1789778315.692637:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778315.692639:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8200, rc 0) 00000100:00100000:3.0:1789778315.692834:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:11519:x1876718296048640:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1475us (1832us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789778315.692843:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:0.0:1789778315.699349:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778315.699379:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb98e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314922368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778315.699475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778315.699602:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314922368 00000100:00100000:0.0:1789778315.699616:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314922368 00000100:00100000:0.0:1789778315.699687:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789778315.699698:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314922368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778315.699766:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778315.699821:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314922368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778315.699829:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789778315.700192:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb98e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314922368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778315.702516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778315.702603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.702676:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296048896 00000100:00100000:2.0:1789778315.702691:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296048896 00000100:00100000:2.0:1789778315.702775:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:2.0:1789778315.702787:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:2374:x1876718296048896:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778315.702808:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778315.702844:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dcf expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.702871:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.702879:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778315.702980:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:2374:x1876718296048896:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 194us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.702989:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778315.703243:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296048768 00000100:00100000:1.0:1789778315.703248:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296048768 00000100:00100000:1.0:1789778315.703310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:1.0:1789778315.703318:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:11519:x1876718296048768:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:1.0:1789778315.703390:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703407:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703420:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703481:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703489:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703495:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703502:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778315.703506:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703514:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703523:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:1.0:1789778315.703526:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789778315.703530:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778315.703536:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c11574418be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778315.703578:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:11519:x1876718296048768:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 260us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778315.703585:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:3.0:1789778315.705769:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778315.705931:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296049152 00000100:00100000:0.0:1789778315.705944:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296049152 00000100:00100000:0.0:1789778315.706016:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1789778315.706029:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:11519:x1876718296049152:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1789778315.706348:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:11519:x1876718296049152:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 321us (592us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789778315.706356:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1789778315.871401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.871527:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296049408 00000100:00100000:2.0:1789778315.871539:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296049408 00000100:00100000:2.0:1789778315.871601:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:2.0:1789778315.871612:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:11537:x1876718296049408:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:2.0:1789778315.871638:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.871686:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7dd6 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.871813:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.871839:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.871851:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778315.871863:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789778315.872017:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dd6 expref: 59 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.872038:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dd6 expref: 58 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.872047:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.872049:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789778315.872053:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8e00, rc 0) 00000100:00100000:2.0:1789778315.872187:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11537:x1876718296049408:12345-192.168.201.45@tcp:101:cat.0 Request processed in 574us (795us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789778315.872194:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 167 00000100:00100000:0.0:1789778315.906051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.906215:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296049536 00000100:00100000:2.0:1789778315.906225:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296049536 00000100:00100000:2.0:1789778315.906285:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:2.0:1789778315.906296:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11538:x1876718296049536:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778315.906334:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.906355:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ddd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.906422:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.906448:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.906476:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778315.906509:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789778315.906513:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778315.906530:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.906554:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ddd expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.906571:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ddd expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.906579:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778315.906581:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778315.906585:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9000, rc 0) 00000100:00100000:2.0:1789778315.906649:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11538:x1876718296049536:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 355us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.906657:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 168 00000100:00100000:1.0:1789778315.919478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778315.919836:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296049920 00000100:00100000:0.0:1789778315.919849:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296049920 00000100:00100000:0.0:1789778315.919913:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:0.0:1789778315.919925:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11538:x1876718296049920:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1789778315.920321:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11538:x1876718296049920:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 397us (862us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789778315.920330:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:0.0:1789778315.926164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.929393:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050048 00000100:00100000:2.0:1789778315.929408:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050048 00000100:00100000:2.0:1789778315.929507:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1789778315.929517:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9563b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11538:x1876718296050048:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:2.0:1789778315.929533:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789778315.929559:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dc1 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.929580:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7dd6 expref: 59 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.929593:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c115744177c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d82 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.929603:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.929613:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778315.929677:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9563b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:11538:x1876718296050048:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 161us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.929684:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00010000:00010000:2.0:1789778315.954105:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778315.957279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.961339:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050176 00000100:00100000:2.0:1789778315.961357:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050176 00000100:00100000:2.0:1789778315.961806:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:2.0:1789778315.961819:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:11538:x1876718296050176:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:2.0:1789778315.961948:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.961966:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.961994:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789778315.962253:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789778315.962346:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:11538:x1876718296050176:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 529us (5291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.962354:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 169 00000100:00100000:1.0:1789778315.993641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778315.994364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050304 00000100:00100000:2.0:1789778315.994377:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050304 00000100:00100000:2.0:1789778315.994490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:2.0:1789778315.994502:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:11540:x1876718296050304:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778315.994525:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778315.994547:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7de4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994625:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994640:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994653:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994668:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994676:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994695:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994797:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994805:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.994812:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778315.994964:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789778315.994969:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778315.994989:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995001:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995009:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995015:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995020:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995026:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778315.995030:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995044:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995056:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778315.995058:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778315.995113:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995120:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c11574418f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995280:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995288:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995293:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995298:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778315.995301:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995307:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995314:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778315.995316:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778315.995319:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995334:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c11574418fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995368:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574418ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995382:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778315.995390:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778315.995392:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778315.995394:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9600, rc 0) 00000100:00100000:2.0:1789778315.995478:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11540:x1876718296050304:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 978us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778315.995487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:0.0:1789778316.051196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778316.051244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778316.051278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778316.051321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778316.051408:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050432 00000100:00100000:1.0:1789778316.051418:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050432 00000100:00100000:1.0:1789778316.051481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 295 00000100:00100000:1.0:1789778316.051492:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718296050432:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778316.051574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718296050432:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 84us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778316.051582:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 295 00000100:00100000:2.0:1789778316.052020:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050688 00000100:00100000:2.0:1789778316.052025:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050688 00000100:00100000:2.0:1789778316.052104:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050560 00000100:00100000:2.0:1789778316.052109:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050560 00000100:00100000:2.0:1789778316.052130:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:2.0:1789778316.052150:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718296050688:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778316.052219:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2372:x1876718296050688:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 70us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.052225:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:2.0:1789778316.052239:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:2.0:1789778316.052246:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2372:x1876718296050560:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778316.052320:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2372:x1876718296050560:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 75us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.052327:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00080000:1.0:1789778316.052429:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789778316.052444:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778316.052605:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050816 00000100:00100000:3.0:1789778316.052611:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050816 00000100:00100000:3.0:1789778316.052660:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00100000:3.0:1789778316.052668:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718296050816:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778316.052707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718296050816:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 41us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778316.052714:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 151 00000100:00080000:1.0:1789778316.052781:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789778316.145314:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789778316.145325:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789778316.145921:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1789778316.145930:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789778316.146128:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebf47f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314922496:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789778316.146232:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0367e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778316.152603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.154203:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296050944 00000100:00100000:3.0:1789778316.154215:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296050944 00000100:00100000:3.0:1789778316.154504:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:3.0:1789778316.154520:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296050944:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789778316.154566:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789778316.154682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296050944:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 167us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778316.154690:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 171 00000100:00100000:2.0:1789778316.157288:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebf47f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314922496:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1789778316.157598:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778316.158773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.159103:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296051072 00000100:00100000:2.0:1789778316.159113:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296051072 00000100:00100000:2.0:1789778316.159164:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:2.0:1789778316.159173:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11551:x1876718296051072:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789778316.159241:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159258:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159270:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159283:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159290:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159307:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159338:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159353:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778316.159395:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789778316.159399:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778316.159411:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159421:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159465:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159474:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159481:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778316.159486:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159495:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159510:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:2.0:1789778316.159513:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778316.159519:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159525:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744190b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159548:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159554:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159560:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159565:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778316.159567:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159573:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778316.159582:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778316.159584:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159589:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441912 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159603:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159610:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159615:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159626:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778316.159639:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159645:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159653:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:2.0:1789778316.159655:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778316.159657:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.159662:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441919 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.159757:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11551:x1876718296051072:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 582us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.159765:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 172 00000100:00100000:3.0:1789778316.182527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778316.183280:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296051328 00000100:00100000:0.0:1789778316.183292:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296051328 00000100:00100000:0.0:1789778316.183361:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:0.0:1789778316.183374:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11551:x1876718296051328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778316.183395:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778316.183417:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441920 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7deb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183536:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183552:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183566:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778316.183577:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789778316.183677:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183684:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183691:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183705:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778316.183710:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183718:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183731:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:0.0:1789778316.183735:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778316.183740:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183747:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183789:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441920 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7deb expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183799:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:0.0:1789778316.183801:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789778316.183805:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441920 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7deb expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.183814:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3400, rc 0) 00000100:00100000:1.0:1789778316.186881:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296051328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3501us (4356us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789778316.186894:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 173 00000100:00100000:0.0:1789778316.201225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.207888:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296051456 00000100:00100000:2.0:1789778316.207907:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296051456 00000100:00100000:2.0:1789778316.207992:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:2.0:1789778316.208003:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296051456:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789778316.208042:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789778316.208182:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296051456:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 180us (6967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.208189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 174 00000100:00100000:3.0:1789778316.216550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778316.218409:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296051712 00000100:00100000:1.0:1789778316.218425:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296051712 00000100:00100000:1.0:1789778316.218495:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 175 00000100:00100000:1.0:1789778316.218505:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296051712:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778316.218525:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778316.218529:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789778316.218559:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574418e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ddd expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.218592:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:1.0:1789778316.218598:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778316.218611:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441935 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7df2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789778316.220512:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789778316.221126:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744193c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.221143:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744193c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.221154:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744193c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.221232:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441935 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df2 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.221251:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744193c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df2 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.221258:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e91b87e00) 00010000:00010000:1.0:1789778316.221260:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778316.221263:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321600, rc 0) 00000100:00100000:1.0:1789778316.221329:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11551:x1876718296051712:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2824us (4789us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789778316.221337:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 175 00000100:00100000:1.0:1789778316.225508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.226566:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296051968 00000100:00100000:2.0:1789778316.226579:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296051968 00000100:00100000:2.0:1789778316.226650:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 176 00000100:00100000:2.0:1789778316.226661:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11551:x1876718296051968:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789778316.226722:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778316.227847:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c115744193c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df2 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.227865:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e91b87e00) 00010000:00010000:2.0:1789778316.227876:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789778316.227899:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.227912:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.227922:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.227937:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.227944:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.227951:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231122:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231142:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231161:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231167:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778316.231172:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231179:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231195:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778316.231198:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778316.231203:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231209:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c115744194a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231225:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231231:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231237:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231242:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778316.231245:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231260:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231269:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6bd9908d (ffff9b3e922c1f00) 00010000:00010000:2.0:1789778316.231272:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778316.231275:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.231281:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441951 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6bd9908d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.231394:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296051968:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 4730us (5891us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789778316.231404:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 176 00000100:00100000:2.0:1789778316.253300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.253365:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296052096 00000100:00100000:3.0:1789778316.253374:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296052096 00000100:00100000:3.0:1789778316.253484:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:3.0:1789778316.253495:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11551:x1876718296052096:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778316.253517:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778316.253544:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441958 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7df9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.253588:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.253603:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.253622:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.253862:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.253879:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.253888:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:3.0:1789778316.253891:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789778316.253894:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c200, rc 0) 00000100:00100000:3.0:1789778316.253962:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11551:x1876718296052096:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 469us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778316.253969:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 177 00000100:00100000:0.0:1789778316.269723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.270682:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296052352 00000100:00100000:3.0:1789778316.270695:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296052352 00000100:00100000:3.0:1789778316.270770:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:3.0:1789778316.270781:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e987e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11551:x1876718296052352:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789778316.270987:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.271007:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.271021:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789778316.271463:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789778316.271479:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371229412877ns, next at 372229410419ns, rc = 0 00000004:00010000:3.0:1789778316.271566:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f54f1e82 reply state 00000000bf48134c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.271575:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778316.271671:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e987e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:11551:x1876718296052352:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 892us (1958us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789778316.271679:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 178 00000100:00100000:2.0:1789778316.278352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.278384:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296052480 00000100:00100000:2.0:1789778316.278394:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296052480 00000100:00100000:2.0:1789778316.278452:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 179 00000100:00100000:2.0:1789778316.278463:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:11551:x1876718296052480:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778316.278782:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778316.278805:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e00 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.279026:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.279036:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.279044:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.279050:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778316.279054:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.279062:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.279098:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:3.0:1789778316.279101:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789778316.279106:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.279249:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.279263:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.279314:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:2.0:1789778316.279317:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789778316.279321:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8200, rc 0) 00000100:00100000:2.0:1789778316.279387:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+63:11551:x1876718296052480:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 926us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.279395:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 179 00010000:00010000:3.0:1789778316.279550:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c1157441966 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778316.289270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.290691:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296052608 00000100:00100000:2.0:1789778316.290704:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296052608 00000100:00100000:2.0:1789778316.290772:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1789778316.290784:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296052608:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789778316.293099:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296052608:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 2282us (3805us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789778316.294438:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000001:00080000:2.0:1789778316.300336:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:2.0:1789778316.300383:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789778316.300398:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3e904a4b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789778316.300404:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3ebdbc7b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3e86467240 00000020:00080000:2.0:1789778316.300406:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3ebdbc7900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3e84edec00 00000100:00100000:0.0:1789778316.301034:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314922624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789778316.301254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789778316.301395:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789778316.301571:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789778316.301802:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314922624 00000100:00100000:3.0:1789778316.301810:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314922624 00000100:00100000:3.0:1789778316.301894:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789778316.301904:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314922624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789778316.301932:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1789778316.301962:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aadd98a, atime: 0x6aadd98a, ctime: 0x6aadd98a, blocks: 0xb 00010000:00010000:3.0:1789778316.301970:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.301987:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1789778316.301991:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778316.301997:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.302012:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.302022:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.302028:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.302084:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789778316.302605:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876718314922624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 701us (1349us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789778316.302613:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789778316.302858:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789778316.302893:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec16fbb80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789778316.302900:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314922624:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789778316.303251:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778316.303258:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.303269:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778316.303274:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.303283:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.303300:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.303308:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b57c9a78/0x5a1e1c1157441974 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.303328:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778316.303330:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778316.303331:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778316.314636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.315771:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296052864 00000100:00100000:2.0:1789778316.315784:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296052864 00000100:00100000:2.0:1789778316.315999:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1789778316.316011:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11551:x1876718296052864:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789778316.316389:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11551:x1876718296052864:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 379us (1766us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789778316.316397:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:3.0:1789778316.328284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.328497:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296053120 00000100:00100000:2.0:1789778316.328507:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296053120 00000100:00100000:2.0:1789778316.328565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:2.0:1789778316.328575:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11551:x1876718296053120:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789778316.329053:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11551:x1876718296053120:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 478us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.329061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 180 00000100:00100000:0.0:1789778316.336058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.336307:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296053248 00000100:00100000:3.0:1789778316.336317:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296053248 00000100:00100000:3.0:1789778316.336376:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:3.0:1789778316.336386:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11551:x1876718296053248:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778316.336407:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778316.336437:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744197b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e07 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.340508:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441982 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.340548:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.340560:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778316.340602:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778316.340623:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.340673:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c600/0x5a1e1c115744197b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e07 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.340695:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e07 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.340704:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:0.0:1789778316.340706:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789778316.340710:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3e00, rc 0) 00000100:00100000:0.0:1789778316.340781:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11551:x1876718296053248:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 4396us (4730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778316.340790:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 181 00000100:00100000:1.0:1789778316.350242:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.350335:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296053376 00000100:00100000:3.0:1789778316.350345:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296053376 00000100:00100000:3.0:1789778316.350405:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:3.0:1789778316.350416:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296053376:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778316.350447:0:8205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778316.350479:0:8205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e0e expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778316.350509:0:8205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd98c, blocks: 0x1 00010000:00010000:3.0:1789778316.350528:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1789778316.350533:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778316.350542:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 8 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.350603:0:8205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 8 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.350618:0:8205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44dc00, rc 0) 00000100:00100000:3.0:1789778316.350869:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296053376:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 453us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778316.350876:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:2.0:1789778316.362378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.362754:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296053632 00000100:00100000:3.0:1789778316.362766:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296053632 00000100:00100000:2.0:1789778316.362917:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:2.0:1789778316.362928:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11551:x1876718296053632:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789778316.363095:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11551:x1876718296053632:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 169us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.363103:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 182 00000100:00100000:1.0:1789778316.379688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.379832:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296053760 00000100:00100000:3.0:1789778316.379843:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296053760 00000100:00100000:3.0:1789778316.379907:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:3.0:1789778316.379917:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:11551:x1876718296053760:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778316.379935:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778316.379954:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e15 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.379986:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 9 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.379995:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778316.380000:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778316.380006:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.380106:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 9 pid: 8205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.380124:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 9 pid: 8205 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.380138:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314922752:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778316.380223:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421000 going to sleep for 11 seconds 00000100:00100000:1.0:1789778316.395244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.395332:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296053888 00000100:00100000:2.0:1789778316.395342:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296053888 00010000:00010000:2.0:1789778316.395382:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 10 pid: 8205 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.395441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:2.0:1789778316.395451:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2374:x1876718296053888:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778316.395478:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778316.395523:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 10 pid: 8205 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.395540:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 10 pid: 8205 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.395568:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778316.395572:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778316.395580:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.395590:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.395626:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.395640:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876718314922880:192.168.201.45@tcp:105: 00000100:00100000:2.0:1789778316.395717:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63180 going to sleep for 11 seconds 00010000:00010000:3.0:1789778316.397129:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9df96ea/0x5a1e1c1157441989 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e0e expref: 10 pid: 8205 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.397153:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314922752:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778316.397186:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.397199:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d600, rc 0) 00000100:00100000:0.0:1789778316.399919:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:11551:x1876718296053760:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 19991us (20228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778316.399932:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:0.0:1789778316.410322:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876718314922880:192.168.201.45@tcp:105: 00010000:00010000:0.0:1789778316.410350:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778316.410602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296053888:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 15151us (15368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778316.410614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:2.0:1789778316.418720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.418955:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296054016 00000100:00100000:3.0:1789778316.418966:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296054016 00002000:00100000:3.0:1789778316.419017:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b3ec16f8e00 x1876718296054016/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:242/0 lens 504/0 e 0 to 0 dl 1789778327 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789778316.419029:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec16f8e00 with x1876718296054016 ext(0->8) 00002000:00010000:3.0:1789778316.419034:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec16f8e00 00000100:00100000:0.0:1789778316.419196:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1789778316.419210:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296054016:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789778316.420363:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2375:x1876718296054016:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 1152us (1648us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789778316.420372:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00002000:00100000:0.0:1789778316.420383:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b3ec16f8e00 x1876718296054016/t4294967315(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:242/0 lens 504/448 e 0 to 0 dl 1789778327 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789778316.420391:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec16f8e00 with x1876718296054016 ext(0->8) 00002000:00010000:0.0:1789778316.420395:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec16f8e00 00000100:00100000:2.0:1789778316.426249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.426328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296054144 00000100:00100000:3.0:1789778316.426349:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296054144 00000100:00100000:3.0:1789778316.426674:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 183 00000100:00100000:3.0:1789778316.426688:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11551:x1876718296054144:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789778316.528051:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11551:x1876718296054144:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 101127us (101570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778316.528094:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 183 00000001:00080000:0.0:1789778316.528454:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:0.0:1789778316.528471:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1789778316.528479:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1789778316.528506:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789778316.528710:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789778316.528722:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789778316.529040:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebf47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314923008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789778316.529131:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778316.529265:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314923008 00000100:00100000:3.0:1789778316.529273:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314923008 00000100:00100000:3.0:1789778316.529324:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789778316.529334:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314923008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789778316.529499:0:8205:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789778316.529504:0:8205:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789778316 00002000:00010000:3.0:1789778316.529506:0:8205:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789778316.529508:0:8205:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789778316 -> 1789778316 00002000:00010000:3.0:1789778316.529510:0:8205:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789778316.529569:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314923008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (437us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789778316.529576:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1789778316.529636:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ebf47c000/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789778316.529644:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebf47c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314923008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789778316.531605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778316.531901:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296054272 00000100:00100000:0.0:1789778316.531911:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296054272 00000100:00100000:0.0:1789778316.532001:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:0.0:1789778316.532011:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2372:x1876718296054272:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789778316.599604:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb9530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2372:x1876718296054272:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 67583us (67996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.599619:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000001:00080000:1.0:1789778316.600045:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1789778316.600501:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:1.0:1789778316.609196:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.609284:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296054528 00000100:00100000:3.0:1789778316.609294:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296054528 00000100:00100000:3.0:1789778316.610096:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:3.0:1789778316.610109:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:11551:x1876718296054528:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789778316.610162:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778316.610190:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441982 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e07 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.610211:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:3.0:1789778316.610225:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778316.610259:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.610273:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.610285:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778316.610555:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095aefc06 reply state 00000000c85fcc14 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.610565:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778316.610669:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11551:x1876718296054528:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 563us (1481us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789778316.610677:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 184 00000100:00100000:3.0:1789778316.614547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.614583:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296054656 00000100:00100000:3.0:1789778316.614593:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296054656 00000100:00100000:3.0:1789778316.614650:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:3.0:1789778316.614661:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296054656:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789778316.614914:0:8205:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789778316.614918:0:8205:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789778316 -> 1789778315 00002000:00010000:3.0:1789778316.614921:0:8205:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789778314 00002000:00010000:3.0:1789778316.614923:0:8205:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789778316 -> 1789778315 00002000:00010000:3.0:1789778316.614925:0:8205:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789778316.614975:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296054656:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 315us (437us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789778316.614995:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00010000:00010000:0.0:1789778316.615674:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.615686:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.615702:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.615708:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44dc00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778316.615712:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.615730:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.615745:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:0.0:1789778316.615748:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778316.615753:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.615759:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44dc00/0x5a1e1c1157441997 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.628477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778316.628706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296054912 00000100:00100000:0.0:1789778316.628717:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296054912 00000100:00100000:0.0:1789778316.628781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 185 00000100:00100000:0.0:1789778316.628792:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb98e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:11551:x1876718296054912:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789778316.628859:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.628875:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.628886:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.628937:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.628952:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 18 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778316.628967:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314923136:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778316.629090:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778316.637957:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.638408:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314923136:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778316.638938:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778316.639024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296055040 00000100:00100000:1.0:1789778316.639031:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296055040 00010000:00010000:1.0:1789778316.639088:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 19 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778316.639127:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:1.0:1789778316.639137:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:2375:x1876718296055040:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778316.639151:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778316.639159:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 19 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.639173:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 19 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.639194:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c200/0x5a1e1c115744195f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7df9 expref: 19 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.639208:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:1.0:1789778316.639212:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.639235:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.639242:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.639263:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778316.639314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:2375:x1876718296055040:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 178us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778316.639321:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00010000:00010000:2.0:1789778316.643680:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643697:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643727:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643734:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643743:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643748:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778316.643753:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643760:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643776:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:2.0:1789778316.643787:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789778316.643793:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.643799:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c115744199e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.643894:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb98e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:11551:x1876718296054912:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 15098us (15421us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789778316.643904:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 185 00000100:00100000:2.0:1789778316.655315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.655351:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296055168 00000100:00100000:2.0:1789778316.655360:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296055168 00000100:00100000:2.0:1789778316.655409:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1789778316.655430:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296055168:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789778316.655476:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.655496:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.655504:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778316.655509:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778316.655513:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.655547:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.655585:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 8 pid: 6691 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.655609:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314923264:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778316.655687:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63180 going to sleep for 11 seconds 00000100:00100000:1.0:1789778316.670772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778316.673215:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296055296 00000100:00100000:3.0:1789778316.673230:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296055296 00010000:00010000:3.0:1789778316.673276:0:12471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 9 pid: 6691 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.673334:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:3.0:1789778316.673344:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296055296:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778316.673359:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778316.673382:0:12471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 9 pid: 6691 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673396:0:12471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 9 pid: 6691 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673433:0:12471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789778316.673438:0:12471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789778316.673444:0:12471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673454:0:12471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673477:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778316.673543:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296055296:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 199us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778316.673563:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00010000:00010000:3.0:1789778316.673716:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6fd4321/0x5a1e1c1157441990 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e15 expref: 8 pid: 6691 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.673732:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314923264:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778316.673751:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673762:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673769:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673790:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673797:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673805:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673812:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778316.673817:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673832:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673844:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.673851:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a52af3/0x5a1e1c11574419a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.673891:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296055168:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 18473us (18583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778316.673899:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:2.0:1789778316.683043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778316.683107:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296055552 00000100:00100000:2.0:1789778316.683117:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296055552 00000100:00100000:2.0:1789778316.683168:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 186 00000100:00100000:2.0:1789778316.683177:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+17:11551:x1876718296055552:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789778316.683257:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.683275:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.683286:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.683508:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.683519:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.683529:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.683579:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778316.683593:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 18 pid: 5846 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778316.683620:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314923392:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778316.683697:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb639c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778316.688608:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778316.690497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296055680 00000100:00100000:1.0:1789778316.690511:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296055680 00010000:00010000:1.0:1789778316.690555:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 19 pid: 5846 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778316.690648:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:1.0:1789778316.690660:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:2374:x1876718296055680:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778316.690674:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778316.690681:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 19 pid: 5846 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.690695:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 19 pid: 5846 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.690727:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:1.0:1789778316.690733:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.690755:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.690763:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.690783:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778316.690842:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:2374:x1876718296055680:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 184us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778316.690849:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00010000:00010000:3.0:1789778316.697925:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c115744196d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e00 expref: 18 pid: 5846 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.697948:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314923392:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778316.697973:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.697983:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.697988:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778316.698188:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789778316.698563:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789778316.698807:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789778316.698909:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314923520:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789778316.698960:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778316.699039:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421900 going to sleep for 11 seconds 00000100:00100000:2.0:1789778316.700490:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314923520 00000100:00100000:2.0:1789778316.700502:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314923520 00000100:00100000:2.0:1789778316.700554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778316.700563:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8093:x1876718314923520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789778316.700665:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8093:x1876718314923520:12345-0@lo:1000:mdt00_003.0 Request processed in 103us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778316.700673:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778316.700714:0:8093:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789778316.700720:0:8093:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ebf47c000, transno 4294967316 00000100:00100000:2.0:1789778316.700733:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314923520:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789778316.701212:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789778316.702673:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314923648:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789778316.702739:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778316.702764:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778316.703024:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314923648 00000100:00100000:2.0:1789778316.703031:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314923648 00000100:00100000:2.0:1789778316.703101:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789778316.703110:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8093:x1876718314923648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789778316.704517:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8093:x1876718314923648:12345-0@lo:1000:mdt00_003.0 Request processed in 1405us (1775us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789778316.704528:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789778316.705006:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8093:1876718314923648:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789778316.705048:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705058:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705089:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705095:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778316.705100:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705110:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705126:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3e82bb5f00) 00010000:00010000:0.0:1789778316.705130:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778316.705135:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705148:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c11574419b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705179:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705186:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705192:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705197:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778316.705200:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705206:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705215:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:0.0:1789778316.705218:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778316.705221:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705226:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c11574418e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705246:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705259:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705274:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705363:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.705378:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 21 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778316.705391:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314923776:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778316.705480:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778316.713923:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314923776:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778316.713953:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.716959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778316.717033:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296055808 00000100:00100000:1.0:1789778316.717086:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296055808 00010000:00010000:1.0:1789778316.717125:0:12471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 22 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778316.717162:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:1.0:1789778316.717172:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:2375:x1876718296055808:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778316.717186:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778316.717193:0:12471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 22 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.717206:0:12471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 22 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.717228:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9600/0x5a1e1c1157441904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7de4 expref: 22 pid: 5845 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.717252:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:1.0:1789778316.717257:0:12471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.717266:0:12471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.717274:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778316.717314:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778316.717367:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:2375:x1876718296055808:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 196us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778316.717375:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00010000:00010000:3.0:1789778316.717890:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717900:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717913:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717919:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717927:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717933:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778316.717937:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717944:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717954:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:3.0:1789778316.717957:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778316.717961:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717976:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c11574419ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717989:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.717995:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.718001:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.718006:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778316.718009:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.718015:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.718023:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1200) 00010000:00010000:3.0:1789778316.718025:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789778316.718028:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.718034:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8600/0x5a1e1c11574419ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778316.718273:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11551:x1876718296055552:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 35094us (35238us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789778316.718401:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 186 00000020:00080000:3.0:1789778316.718411:0:8093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789778316.718461:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778316.718466:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778316.719113:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789778316.719122:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789778316.724937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778316.725004:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296056064 00000100:00100000:1.0:1789778316.725013:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296056064 00000100:00100000:1.0:1789778316.725099:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:1.0:1789778316.725110:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86774c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11551:x1876718296056064:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789778316.726525:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789778316.726622:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1789778316.726668:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.726682:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.726690:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.726696:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.726708:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.726712:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778316.726735:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789778316.726825:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86774c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:11551:x1876718296056064:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 1714us (1893us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789778316.726834:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000020:00080000:0.0:1789778316.726839:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789778316.726964:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778316.726971:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.726978:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778316.726982:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.726990:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.727004:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b3ea4c7a000) 00010000:00010000:3.0:1789778316.727008:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789778316.727012:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.727018:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c11574419c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778316.727035:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778316.727038:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778316.727039:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778316.942411:0:12511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789778316.942432:0:12511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778316.942482:0:12511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789778316.942491:0:12511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789778316.977468:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778317.095662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778317.095699:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296056320 00000100:00100000:0.0:1789778317.095710:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296056320 00000100:00100000:0.0:1789778317.095773:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:0.0:1789778317.095783:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:11561:x1876718296056320:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778317.095809:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778317.095829:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574419c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e1c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.095925:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574419cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.095940:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574419cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.095967:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574419cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778317.095979:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789778317.096124:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574419c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e1c expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.096154:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574419cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e1c expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.096163:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778317.096167:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789778317.096170:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2200, rc 0) 00000100:00100000:0.0:1789778317.096229:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11561:x1876718296056320:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 447us (581us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789778317.096237:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 187 00000100:00100000:1.0:1789778317.098337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.098539:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296056448 00000100:00100000:2.0:1789778317.098550:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296056448 00000100:00100000:2.0:1789778317.098619:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:2.0:1789778317.098629:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11561:x1876718296056448:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1789778317.098708:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.098724:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.098735:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.098751:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.098759:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.098766:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099016:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099025:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099033:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778317.099109:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099123:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099129:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099137:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099143:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.099147:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099156:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099168:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778317.099172:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.099176:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099189:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c11574419dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099202:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099208:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099214:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099219:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.099222:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099228:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099236:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1f00) 00010000:00010000:2.0:1789778317.099239:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.099242:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099247:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c11574419e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099261:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099266:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099634:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099639:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.099642:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099649:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099658:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778317.099661:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.099663:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.099669:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c11574419eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.099758:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11561:x1876718296056448:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1127us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778317.099767:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 188 00000100:00100000:3.0:1789778317.154193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778317.154286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296056704 00000100:00100000:0.0:1789778317.154296:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296056704 00000100:00100000:0.0:1789778317.154376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:0.0:1789778317.154388:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11565:x1876718296056704:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778317.154427:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778317.154449:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574419f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e23 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154587:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154598:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154615:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154622:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154629:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154887:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154896:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.154904:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778317.154912:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789778317.154997:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155005:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155012:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155024:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778317.155028:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155035:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155047:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778317.155049:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778317.155054:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155059:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c11574419f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155092:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155099:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155105:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155110:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778317.155112:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155119:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155139:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778317.155142:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778317.155144:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155150:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155191:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c11574419f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155205:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.155212:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778317.155214:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778317.155217:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3400, rc 0) 00000100:00100000:0.0:1789778317.155282:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11565:x1876718296056704:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 895us (1097us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789778317.155289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 189 00000100:00100000:3.0:1789778317.169770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.170128:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296056832 00000100:00100000:2.0:1789778317.170139:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296056832 00000100:00100000:2.0:1789778317.170192:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:2.0:1789778317.170201:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11565:x1876718296056832:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1789778317.170284:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170439:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170464:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170491:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170498:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170505:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170511:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.170516:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170523:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170534:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778317.170537:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778317.170541:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.170547:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441a15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.170625:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11565:x1876718296056832:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 424us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778317.170633:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 190 00000100:00100000:2.0:1789778317.193110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.193162:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296057088 00000100:00100000:2.0:1789778317.193174:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296057088 00000100:00100000:2.0:1789778317.193229:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1789778317.193239:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11565:x1876718296057088:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778317.193469:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:11565:x1876718296057088:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 231us (368us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789778317.193478:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1789778317.258394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778317.262118:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296057344 00000100:00100000:1.0:1789778317.262136:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296057344 00000100:00100000:1.0:1789778317.262207:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:1.0:1789778317.262218:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:11099:x1876718296057344:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:1.0:1789778317.262244:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778317.262269:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441a1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.262401:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.262428:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.262438:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.262477:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.262494:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 28 pid: 5845 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.262508:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebf47ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314923904:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778317.262609:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea03679c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778317.265643:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebf47ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314923904:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778317.265672:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.268615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778317.268708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296057472 00000100:00100000:1.0:1789778317.268719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296057472 00010000:00010000:1.0:1789778317.268762:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 29 pid: 5845 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.268801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 75 00000100:00100000:1.0:1789778317.268825:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:2374:x1876718296057472:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778317.268840:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778317.268847:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 29 pid: 5845 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.268870:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 29 pid: 5845 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.268892:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e23 expref: 29 pid: 5845 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.268906:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:1.0:1789778317.268911:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.268921:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.268928:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.268961:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778317.269017:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:2374:x1876718296057472:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 194us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778317.269024:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 75 00010000:00010000:2.0:1789778317.269190:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.269199:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778317.269216:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789778317.269359:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321600/0x5a1e1c1157441a1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.269374:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.269382:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778317.269385:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789778317.269387:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321200, rc 0) 00000100:00100000:2.0:1789778317.269424:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:11099:x1876718296057344:12345-192.168.201.45@tcp:101:bash.0 Request processed in 7208us (11042us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789778317.269431:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 191 00000100:00100000:2.0:1789778317.272058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.272252:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296057728 00000100:00100000:3.0:1789778317.272263:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296057728 00000100:00100000:3.0:1789778317.272318:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 192 00000100:00100000:3.0:1789778317.272328:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:11099:x1876718296057728:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:3.0:1789778317.272622:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.272639:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.272651:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778317.272810:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789778317.272838:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000879ff7a0 reply state 00000000e0a043e7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778317.272847:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789778317.272974:0:8093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789778317.273394:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:11099:x1876718296057728:12345-192.168.201.45@tcp:36:bash.0 Request processed in 1064us (1344us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789778317.273401:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 192 00000020:00080000:3.0:1789778317.273407:0:8093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789778317.280159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778317.280240:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296057856 00000100:00100000:0.0:1789778317.280251:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296057856 00000100:00100000:0.0:1789778317.280308:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 193 00000100:00100000:0.0:1789778317.280319:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:11099:x1876718296057856:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778317.280343:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778317.280365:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441a38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e31 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.280464:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441a38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e31 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.280483:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441a38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e31 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.280505:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778317.280508:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778317.280512:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3e00, rc 0) 00000100:00100000:0.0:1789778317.280581:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+33:11099:x1876718296057856:12345-192.168.201.45@tcp:101:bash.0 Request processed in 263us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778317.280588:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 193 00010000:00010000:3.0:1789778317.281241:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.281250:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.281256:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.281262:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778317.281266:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.281286:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.281298:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:3.0:1789778317.281301:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778317.281305:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.281310:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441a31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.284340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.284436:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296057984 00000100:00100000:3.0:1789778317.284447:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296057984 00000100:00100000:3.0:1789778317.284514:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1789778317.284525:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:11099:x1876718296057984:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1789778317.284547:0:8205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778317.284570:0:8205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e38 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778317.284597:0:8205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aadd98b, atime: 0x6aadd98a, ctime: 0x6aadd98b, blocks: 0xb 00010000:00010000:3.0:1789778317.284620:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1789778317.284624:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778317.284633:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 8 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.284651:0:8205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 8 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.284696:0:8205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d000, rc 0) 00000100:00100000:3.0:1789778317.284767:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:11099:x1876718296057984:12345-192.168.201.45@tcp:101:bash.0 Request processed in 245us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778317.284774:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:1.0:1789778317.293688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.293866:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296058112 00000100:00100000:2.0:1789778317.293877:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296058112 00002000:00010000:2.0:1789778317.293919:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789778317.293925:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ebf47ed80 with x1876718296058112 ext(0->18446744073709551615) 00002000:00010000:2.0:1789778317.293936:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ebf47ed80. 00000100:00100000:2.0:1789778317.293972:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1789778317.293983:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296058112:12345-192.168.201.45@tcp:10:bash.0 00002000:00010000:2.0:1789778317.294307:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789778317.294311:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789778315 -> 1789778317 00002000:00010000:2.0:1789778317.294314:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789778314 -> 1789778314 00002000:00010000:2.0:1789778317.294316:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789778315 -> 1789778317 00002000:00010000:2.0:1789778317.294318:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789778317.294377:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296058112:12345-192.168.201.45@tcp:10:bash.0 Request processed in 396us (700us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789778317.294385:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00002000:00010000:2.0:1789778317.294388:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789778317.294391:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ebf47ed80 with x1876718296058112 ext(0->18446744073709551615) 00002000:00010000:2.0:1789778317.294396:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ebf47ed80. 00000100:00100000:1.0:1789778317.416025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.416127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296058240 00000100:00100000:2.0:1789778317.416136:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296058240 00000100:00100000:2.0:1789778317.416199:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:2.0:1789778317.416209:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:11579:x1876718296058240:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:2.0:1789778317.416279:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416311:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416323:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416340:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416346:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416352:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416609:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416618:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416625:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778317.416666:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416678:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416695:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416844:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416851:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.416864:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416873:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416886:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778317.416889:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.416894:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416900:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416914:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416920:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416926:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416931:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.416934:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416950:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416956:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778317.416958:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.416960:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416963:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416973:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416976:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416980:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416983:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.416985:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416988:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.416991:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778317.416993:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.416994:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.417008:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.417146:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:11579:x1876718296058240:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 936us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778317.417155:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 194 00000100:00100000:1.0:1789778317.457313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778317.457468:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296058496 00000100:00100000:0.0:1789778317.457479:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296058496 00000100:00100000:0.0:1789778317.457850:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:0.0:1789778317.457862:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+32:11582:x1876718296058496:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778317.457884:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778317.457906:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e3f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.457983:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.457997:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458009:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458037:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458044:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458051:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458515:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458527:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458535:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778317.458546:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789778317.458912:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458922:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458928:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458935:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778317.458939:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458957:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458971:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778317.458974:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778317.458979:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458985:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441a62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.458999:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459005:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459011:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459016:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778317.459019:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459025:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459032:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778317.459035:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778317.459038:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459055:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441a69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459435:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e3f expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459451:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e3f expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.459458:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778317.459461:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789778317.459463:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3400, rc 0) 00000100:00100000:0.0:1789778317.459538:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:11582:x1876718296058496:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 1678us (2235us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789778317.459547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 195 00000100:00100000:1.0:1789778317.462019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.462268:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296058624 00000100:00100000:2.0:1789778317.462279:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296058624 00000100:00100000:2.0:1789778317.462335:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:2.0:1789778317.462345:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:11582:x1876718296058624:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1789778317.462432:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.462449:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.462458:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.462493:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.462507:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 34 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.462521:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314924032:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778317.462659:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e91190a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778317.464480:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314924032:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778317.464509:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.464600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.465105:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296058880 00000100:00100000:2.0:1789778317.465111:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296058880 00000100:00100000:2.0:1789778317.465164:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:2.0:1789778317.465174:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:5626:x1876718296058880:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789778317.465436:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:5626:x1876718296058880:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 263us (838us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789778317.465441:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:1.0:1789778317.467935:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.468154:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296059008 00000100:00100000:3.0:1789778317.468163:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296059008 00010000:00010000:3.0:1789778317.468201:0:12471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 36 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778317.468241:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:3.0:1789778317.468250:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:2374:x1876718296059008:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778317.468263:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778317.468271:0:12471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 36 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.468284:0:12471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 36 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.468306:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441a23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e2a expref: 36 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.468322:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:3.0:1789778317.468327:0:12471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.468335:0:12471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.468353:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.468380:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778317.468451:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9563bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:2374:x1876718296059008:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 201us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778317.468459:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00010000:00010000:2.0:1789778317.469327:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469336:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469363:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469367:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469372:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469375:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.469378:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469393:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469402:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778317.469404:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778317.469418:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.469424:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.469579:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:11582:x1876718296058624:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 7231us (7567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778317.469588:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 196 00000100:00100000:1.0:1789778317.473023:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.473401:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296059264 00000100:00100000:2.0:1789778317.473422:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296059264 00000100:00100000:2.0:1789778317.473513:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:2.0:1789778317.473524:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+34:11582:x1876718296059264:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778317.474096:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:11582:x1876718296059264:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 528us (1039us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789778317.474106:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:1.0:1789778317.581355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.581494:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296059520 00000100:00100000:2.0:1789778317.581505:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296059520 00000100:00100000:2.0:1789778317.581568:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:2.0:1789778317.581579:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+35:11593:x1876718296059520:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:2.0:1789778317.581615:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778317.581641:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e46 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.581750:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.581765:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.581778:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.581793:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.581800:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.581807:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582095:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441a9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582105:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582113:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778317.582124:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789778317.582213:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582220:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582232:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582237:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.582241:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582248:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582260:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778317.582263:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.582268:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582274:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441a8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582287:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582293:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582298:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582302:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.582305:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582322:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582331:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:2.0:1789778317.582333:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.582336:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582341:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441a93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582380:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441a85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e46 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582395:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441a9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e46 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.582402:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778317.582416:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778317.582418:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8800, rc 0) 00000100:00100000:2.0:1789778317.582492:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:11593:x1876718296059520:12345-192.168.201.45@tcp:101:cat.0 Request processed in 915us (1147us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789778317.582500:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 197 00000100:00100000:1.0:1789778317.586953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.587058:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296059776 00000100:00100000:2.0:1789778317.587088:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296059776 00000100:00100000:2.0:1789778317.587160:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:2.0:1789778317.587172:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:11593:x1876718296059776:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:2.0:1789778317.587437:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:11593:x1876718296059776:12345-192.168.201.45@tcp:35:cat.0 Request processed in 267us (495us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789778317.587444:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 54 00000100:00100000:1.0:1789778317.610457:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.610714:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296060032 00000100:00100000:3.0:1789778317.610725:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296060032 00000100:00100000:3.0:1789778317.610787:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 198 00000100:00100000:3.0:1789778317.610798:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:11594:x1876718296060032:12345-192.168.201.45@tcp:36:rm.0 00010000:00010000:3.0:1789778317.610981:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789778317.611008:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8800/0x5a1e1c1157441a9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e46 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611029:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441a70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e3f expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611042:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441a38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e31 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611053:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:3.0:1789778317.611097:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778317.611122:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611298:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611322:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611338:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611346:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.611352:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.612056:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.612097:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.612105:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789778317.612821:0:8093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789778317.612833:0:8093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372570766864ns, next at 373570763803ns, rc = 0 00010000:00010000:3.0:1789778317.613001:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613012:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613021:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613041:0:8093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613058:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613092:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613116:0:8093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778317.613367:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778317.613375:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.613382:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778317.613386:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.613394:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.613417:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e82bb5700) 00010000:00010000:2.0:1789778317.613420:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789778317.613424:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.613430:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441abd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.613443:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778317.613445:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778317.613446:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778317.613481:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613488:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613494:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613499:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44ca00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778317.613502:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613508:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613516:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b3e82bb5700) 00010000:00010000:3.0:1789778317.613518:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789778317.613521:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613537:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441ab6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613559:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613564:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613570:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613576:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778317.613578:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613644:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613653:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:3.0:1789778317.613655:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778317.613658:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.613663:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441aa8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778317.613673:0:8093:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3b98f70 reply state 00000000211421e8 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778317.613682:0:8093:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789778317.613954:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+37:11594:x1876718296060032:12345-192.168.201.45@tcp:36:rm.0 Request processed in 3153us (3502us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789778317.613962:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 198 00010000:00010000:0.0:1789778317.618044:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.618092:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.618101:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.618108:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44da00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778317.618114:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.618122:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.618167:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e82bb5800) 00010000:00010000:0.0:1789778317.618170:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778317.618176:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.618183:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441aaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.673341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.673454:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296060288 00000100:00100000:2.0:1789778317.673466:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296060288 00000100:00100000:2.0:1789778317.673530:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 199 00000100:00100000:2.0:1789778317.673540:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+36:11600:x1876718296060288:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778317.673567:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778317.673617:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441ac4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e4d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.673756:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.673773:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.673786:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.673801:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.673808:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.673814:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789778317.674383:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789778317.674563:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674573:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674581:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674617:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674635:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674641:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674649:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778317.674655:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674664:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674678:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778317.674681:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778317.674687:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674693:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441acb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778317.674708:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000776ebc73 reply state 00000000bf92f828 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.674717:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789778317.674753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441ac4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674766:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.674786:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:2.0:1789778317.674788:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778317.674791:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9000, rc 0) 00000100:00100000:2.0:1789778317.674864:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:11600:x1876718296060288:12345-192.168.201.45@tcp:101:bash.0 Request processed in 1325us (1533us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789778317.674872:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 199 00010000:00010000:3.0:1789778317.677540:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.677557:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.677564:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.677571:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778317.677575:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.677594:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.677610:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e922c1600) 00010000:00010000:3.0:1789778317.677613:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778317.677618:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.677625:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8000/0x5a1e1c1157441ad2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.682260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.682432:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296060416 00000100:00100000:3.0:1789778317.682443:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296060416 00000100:00100000:3.0:1789778317.682563:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1789778317.682574:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718296060416:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1789778317.682620:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778317.682642:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e54 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778317.682667:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778317.682684:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1789778317.682689:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778317.682698:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.682719:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.682733:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d600, rc 0) 00000100:00100000:3.0:1789778317.682939:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296060416:12345-192.168.201.45@tcp:101:bash.0 Request processed in 366us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778317.682947:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:1.0:1789778317.690707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.690786:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296060544 00000100:00100000:3.0:1789778317.690796:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296060544 00000100:00100000:3.0:1789778317.690856:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:3.0:1789778317.690866:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:11600:x1876718296060544:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1789778317.690884:0:8205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778317.690902:0:8205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e5b expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.690936:0:8205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.690958:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778317.690961:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778317.690966:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 7 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.690993:0:8205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.691003:0:8205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 7 pid: 6694 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778317.691015:0:8205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5df2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314924160:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778317.691117:0:8205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421840 going to sleep for 11 seconds 00000100:00100000:3.0:1789778317.692729:0:8205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5df2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8205:1876718314924160:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778317.692772:0:8205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 7 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.692794:0:8205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44ca00, rc 0) 00000100:00100000:3.0:1789778317.695937:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:11600:x1876718296060544:12345-192.168.201.45@tcp:101:bash.0 Request processed in 5060us (5229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778317.695952:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:1.0:1789778317.698964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778317.700187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296060672 00000100:00100000:1.0:1789778317.700199:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296060672 00010000:00010000:1.0:1789778317.700241:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 7 pid: 6694 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.700353:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:1.0:1789778317.700367:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296060672:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778317.700382:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778317.700416:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 7 pid: 6694 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.700431:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 7 pid: 6694 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.700455:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441ae7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e54 expref: 7 pid: 6694 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.700470:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778317.700487:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778317.700495:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 6 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.700505:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 6 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.700541:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 6 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.700555:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1876718314924288:192.168.201.45@tcp:105: 00000100:00100000:1.0:1789778317.700932:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea03679c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778317.703909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.703972:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1876718314924288:192.168.201.45@tcp:105: 00000100:00100000:0.0:1789778317.703993:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296060928 00010000:00010000:2.0:1789778317.703996:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778317.703999:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296060928 00000100:00100000:2.0:1789778317.704050:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296060672:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 3685us (5093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778317.704058:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:2.0:1789778317.704059:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:0.0:1789778317.704087:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+38:11600:x1876718296060928:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:0.0:1789778317.704430:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:11600:x1876718296060928:12345-192.168.201.45@tcp:35:bash.0 Request processed in 345us (531us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789778317.704438:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 55 00000100:00100000:0.0:1789778317.864422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.864526:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296061056 00000100:00100000:2.0:1789778317.864537:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296061056 00000100:00100000:2.0:1789778317.864597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:2.0:1789778317.864608:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+39:11616:x1876718296061056:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778317.864633:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778317.864653:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e62 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.864830:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441afc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.864845:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441afc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.864883:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441afc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778317.864917:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789778317.864921:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778317.864938:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441afc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.864964:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9e00/0x5a1e1c1157441af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e62 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.864983:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441afc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e62 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.864992:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:2.0:1789778317.864994:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778317.864998:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9400, rc 0) 00000100:00100000:2.0:1789778317.865289:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+40:11616:x1876718296061056:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 681us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778317.865297:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 200 00000100:00100000:1.0:1789778317.872959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.873662:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296061312 00000100:00100000:2.0:1789778317.873673:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296061312 00000100:00100000:2.0:1789778317.873797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:2.0:1789778317.873809:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+40:11616:x1876718296061312:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778317.873831:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778317.873863:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441b03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e69 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.873985:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441b0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.873998:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.874010:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778317.874020:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789778317.874200:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8e00/0x5a1e1c1157441b03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e69 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.874219:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e69 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.874228:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:2.0:1789778317.874230:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778317.874233:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9200, rc 0) 00000100:00100000:2.0:1789778317.874300:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+42:11616:x1876718296061312:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 493us (1351us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789778317.874307:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 201 00000100:00100000:1.0:1789778317.878426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778317.878470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.878609:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296061696 00000100:00100000:3.0:1789778317.878620:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296061696 00000100:00100000:0.0:1789778317.878754:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296061568 00000100:00100000:0.0:1789778317.878758:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296061568 00000100:00100000:0.0:1789778317.878805:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:0.0:1789778317.878816:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+43:11616:x1876718296061568:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778317.878838:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778317.878867:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e70 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.878956:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.878989:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.879001:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778317.879013:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789778317.879186:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e70 expref: 46 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.879206:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e70 expref: 45 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.879216:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:0.0:1789778317.879219:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789778317.879222:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2c00, rc 0) 00000100:00100000:0.0:1789778317.879278:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+45:11616:x1876718296061568:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 464us (807us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789778317.879284:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 202 00000100:00100000:3.0:1789778317.879793:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1789778317.879813:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+44:2374:x1876718296061696:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778317.879826:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778317.879842:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9200/0x5a1e1c1157441b0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e69 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.879868:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:3.0:1789778317.879871:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778317.879909:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+43:2374:x1876718296061696:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 100us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778317.879915:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1789778317.886379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.886515:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296061824 00000100:00100000:2.0:1789778317.886524:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296061824 00000100:00100000:2.0:1789778317.886593:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:2.0:1789778317.886604:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+6:2375:x1876718296061824:12345-192.168.201.45@tcp:1:lfs.0 00010000:00010000:2.0:1789778317.886651:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.886693:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 6 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.886700:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778317.886705:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778317.886709:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.886746:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 6 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.886761:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 6 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.886774:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876718314924416:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778317.886852:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e911900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778317.889863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.890011:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876718314924416:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778317.890035:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.890478:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296061952 00000100:00100000:1.0:1789778317.890487:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296061952 00002000:00100000:1.0:1789778317.890535:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b3eb581f480 x1876718296061952/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:243/0 lens 504/0 e 0 to 0 dl 1789778328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789778317.890544:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3eb581f480 with x1876718296061952 ext(0->8) 00010000:00010000:1.0:1789778317.890552:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 7 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.890565:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 7 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789778317.890594:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3eb581f480 00000100:00100000:1.0:1789778317.890629:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1789778317.890639:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2374:x1876718296061952:12345-192.168.201.45@tcp:4:lfs.0 00000100:00100000:1.0:1789778317.891424:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2374:x1876718296061952:12345-192.168.201.45@tcp:4:lfs.0 Request processed in 781us (1573us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789778317.891435:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00002000:00100000:1.0:1789778317.891444:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b3eb581f480 x1876718296061952/t4294967308(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:243/0 lens 504/448 e 0 to 0 dl 1789778328 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789778317.891453:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3eb581f480 with x1876718296061952 ext(0->8) 00010000:00010000:1.0:1789778317.891460:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 9 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.891474:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 9 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789778317.891481:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b3eb581f480 00000100:00100000:0.0:1789778317.894949:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.895249:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296062080 00000100:00100000:3.0:1789778317.895261:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296062080 00010000:00010000:3.0:1789778317.895305:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 9 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778317.895350:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:3.0:1789778317.895361:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296062080:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778317.895376:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789778317.895396:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789778317.895408:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789778317 00002000:00010000:3.0:1789778317.895411:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789778318 00002000:00010000:3.0:1789778317.895413:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789778317 00010000:00010000:3.0:1789778317.895420:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 9 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.895434:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 9 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.895476:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441aee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e5b expref: 9 pid: 8205 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.895494:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789778317.895499:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789778317.895504:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.895514:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778317.895647:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778317.895729:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2375:x1876718296062080:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 370us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778317.895736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00010000:00010000:0.0:1789778317.897461:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897479:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897534:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897543:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897551:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897559:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778317.897563:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897571:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897591:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.897598:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441b2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778317.897823:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296061824:12345-192.168.201.45@tcp:1:lfs.0 Request processed in 11216us (11450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778317.897832:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:1.0:1789778317.901829:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778317.901871:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296062336 00000100:00100000:3.0:1789778317.901881:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296062336 00000100:00100000:3.0:1789778317.901936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 56 00000100:00100000:3.0:1789778317.901945:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86774850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+43:11616:x1876718296062336:12345-192.168.201.45@tcp:35:lfs.0 00000004:00010000:3.0:1789778317.902000:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e70 expref: 43 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789778317.902339:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1789778317.902380:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789778317.902650:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1789778317.902708:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.902741:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.902751:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.902784:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778317.902798:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 47 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778317.902813:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314924544:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778317.902983:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778317.905848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778317.905938:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296062464 00000100:00100000:1.0:1789778317.905948:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296062464 00010000:00010000:1.0:1789778317.905987:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 48 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778317.906016:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876718314924544:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778317.906030:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1789778317.906039:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+48:2375:x1876718296062464:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778317.906039:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.906299:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778317.906306:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 48 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.906316:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 48 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.906332:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441ad9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e4d expref: 48 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.906344:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:1.0:1789778317.906347:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.906353:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.906360:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.906381:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778317.906445:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+47:2375:x1876718296062464:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 407us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778317.906452:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00010000:00010000:0.0:1789778317.906665:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.906673:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789778317.906918:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789778317.907143:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1789778317.907247:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314924672:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789778317.907296:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778317.907371:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777840 going to sleep for 11 seconds 00000100:00100000:2.0:1789778317.907419:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314924672 00000100:00100000:2.0:1789778317.907426:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314924672 00000100:00100000:2.0:1789778317.907493:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789778317.907502:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876718314924672:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789778317.907643:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876718314924672:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778317.907651:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789778317.907723:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314924672:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789778317.908082:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789778317.908130:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314924800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789778317.908161:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778317.908473:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314924800 00000100:00100000:0.0:1789778317.908479:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314924800 00000100:00100000:1.0:1789778317.908488:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea1fb2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789778317.908506:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789778317.908513:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876718314924800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789778317.908662:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1876718314924800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 148us (498us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789778317.908669:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789778317.910083:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e98616d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876718314924800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789778317.910167:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1789778317.910221:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.910228:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.910233:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.910237:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778317.910241:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.910245:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.910258:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:1.0:1789778317.910260:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789778317.910263:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778317.910267:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441b34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789778317.910433:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789778317.910541:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789778317.910552:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372868486391ns, next at 373868483809ns, rc = 0 00000001:00080000:1.0:1789778317.910559:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789778317.910792:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3e922c1f00) 00010000:00010000:1.0:1789778317.910795:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789778317.910802:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e70 expref: 51 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778317.910928:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86774850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:11616:x1876718296062336:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 8982us (9104us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1789778317.910938:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 56 00000020:00080000:1.0:1789778317.910943:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789778317.916747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778317.916832:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296062592 00000100:00100000:0.0:1789778317.916843:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296062592 00000100:00100000:0.0:1789778317.916910:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00100000:0.0:1789778317.916920:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+50:11616:x1876718296062592:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778317.916943:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778317.916965:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441b3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.917039:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441b3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e77 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.917055:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441b3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e77 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778317.917115:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778317.917119:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778317.917123:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3400, rc 0) 00000100:00100000:0.0:1789778317.917173:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:11616:x1876718296062592:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 254us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778317.917180:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 203 00000100:00100000:0.0:1789778317.920965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778317.921098:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296062848 00000100:00100000:2.0:1789778317.921109:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296062848 00000100:00100000:2.0:1789778317.921168:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 57 00000100:00100000:2.0:1789778317.921178:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+51:11616:x1876718296062848:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778317.921463:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:11616:x1876718296062848:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 286us (508us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789778317.921470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 57 00010000:00010000:0.0:1789778318.001530:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778318.003101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.003179:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296062976 00000100:00100000:0.0:1789778318.003188:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296062976 00000100:00100000:0.0:1789778318.003245:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:0.0:1789778318.003253:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:11626:x1876718296062976:12345-192.168.201.45@tcp:34:lfs.0 00010000:00010000:0.0:1789778318.003314:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003327:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003335:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003361:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003366:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003370:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003469:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003482:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003488:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789778318.003542:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003554:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003559:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003565:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.003571:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.003575:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789778318.003984:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789778318.004027:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004040:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778318.004043:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.004048:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004054:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004092:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004099:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004105:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004110:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.004113:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004119:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778318.004129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.004131:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004147:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004163:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004168:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004174:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004178:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.004181:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004187:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004195:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.004197:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.004200:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.004205:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778318.004323:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:11626:x1876718296062976:12345-192.168.201.45@tcp:34:lfs.0 Request processed in 1068us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778318.004331:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 204 00000100:00100000:3.0:1789778318.040438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.040528:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296063232 00000100:00100000:0.0:1789778318.040549:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296063232 00000100:00100000:0.0:1789778318.040616:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 205 00000100:00100000:0.0:1789778318.040625:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+52:11629:x1876718296063232:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778318.040646:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778318.040667:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e7e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040738:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040753:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040764:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040778:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040784:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040791:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040921:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040931:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.040956:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778318.040968:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789778318.041109:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041117:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041123:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041128:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.041250:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041257:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041266:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778318.041267:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.041270:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041274:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441b5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041285:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041288:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041297:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041301:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.041302:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041306:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041310:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778318.041311:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.041313:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041316:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041347:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041357:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.041361:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.041362:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778318.041364:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2c00, rc 0) 00000100:00100000:0.0:1789778318.041441:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:11629:x1876718296063232:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 816us (1014us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789778318.041458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 205 00000100:00100000:1.0:1789778318.046057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778318.046514:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296063360 00000100:00100000:2.0:1789778318.046526:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296063360 00000100:00100000:2.0:1789778318.046756:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:2.0:1789778318.046768:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:11629:x1876718296063360:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:2.0:1789778318.046836:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046866:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046880:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046906:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046913:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046919:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046924:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778318.046928:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046955:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046968:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:2.0:1789778318.046971:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778318.046976:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.046982:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441b7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778318.047062:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:11629:x1876718296063360:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 295us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778318.047094:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 206 00000100:00100000:2.0:1789778318.050216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.051822:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296063616 00000100:00100000:0.0:1789778318.051836:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296063616 00000100:00100000:0.0:1789778318.051907:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:0.0:1789778318.051918:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+54:11629:x1876718296063616:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:0.0:1789778318.052575:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:11629:x1876718296063616:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 656us (2366us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789778318.052584:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 58 00000100:00100000:3.0:1789778318.120018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.120304:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296063872 00000100:00100000:0.0:1789778318.120314:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296063872 00000100:00100000:0.0:1789778318.120519:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 207 00000100:00100000:0.0:1789778318.120529:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:11639:x1876718296063872:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778318.120550:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778318.120553:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789778318.120577:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441afc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e62 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.120593:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778318.120596:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789778318.120607:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e85 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.120702:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.120712:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.120738:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.120790:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.120804:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 55 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778318.120818:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314924928:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778318.120952:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789778318.130525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778318.131145:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296064000 00000100:00100000:3.0:1789778318.131176:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296064000 00010000:00010000:3.0:1789778318.131225:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 56 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778318.131263:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:3.0:1789778318.131273:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:2375:x1876718296064000:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778318.131288:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778318.131295:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 56 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.131309:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 56 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.131331:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778318.131349:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.131358:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.131365:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.131385:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778318.131451:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+56:2375:x1876718296064000:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 178us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778318.131459:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00010000:00010000:0.0:1789778318.134539:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441b6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e7e expref: 55 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778318.134561:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314924928:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778318.134584:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.134592:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.134596:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778318.134669:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789778318.135041:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441b81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 56 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.135160:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 55 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.135170:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.135173:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789778318.135177:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f2800, rc 0) 00000100:00100000:0.0:1789778318.135249:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:11639:x1876718296063872:12345-192.168.201.45@tcp:101:bash.0 Request processed in 14720us (15240us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789778318.135259:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 207 00000100:00100000:1.0:1789778318.141220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.147919:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296064256 00000100:00100000:0.0:1789778318.147934:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296064256 00000100:00100000:1.0:1789778318.149966:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 208 00000100:00100000:1.0:1789778318.149979:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+55:11639:x1876718296064256:12345-192.168.201.45@tcp:36:bash.0 00010000:00010000:1.0:1789778318.150281:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.150300:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.150313:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789778318.150366:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789778318.150391:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b0ef17e reply state 0000000084d91c31 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.150464:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789778318.150592:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11639:x1876718296064256:12345-192.168.201.45@tcp:36:bash.0 Request processed in 615us (9384us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789778318.150610:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 208 00000020:00080000:1.0:1789778318.150621:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789778318.152840:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.152855:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.152862:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.152868:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.152873:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.152880:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.152896:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.152899:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.152918:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.152925:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441b96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.155928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778318.156006:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296064384 00000100:00100000:3.0:1789778318.156016:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296064384 00000100:00100000:3.0:1789778318.156108:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:3.0:1789778318.156117:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:11639:x1876718296064384:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:3.0:1789778318.156139:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778318.156156:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441b9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e8c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.156227:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.156240:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 58 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.156249:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.156279:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 58 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.156292:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 58 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778318.156306:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3e909c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314925056:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778318.156389:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778318.160412:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3e909c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876718314925056:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778318.160440:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.164140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.166346:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296064512 00000100:00100000:0.0:1789778318.166363:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296064512 00010000:00010000:0.0:1789778318.166422:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 59 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778318.166504:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1789778318.166515:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:2375:x1876718296064512:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778318.166531:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778318.166538:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 59 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.166552:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 59 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.166575:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441b88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e85 expref: 59 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.166593:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.166598:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.166607:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.166630:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.166667:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778318.166737:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:2375:x1876718296064512:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 223us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778318.166744:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00010000:00010000:1.0:1789778318.167216:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.167225:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778318.167271:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789778318.167275:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778318.167295:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.167326:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441b9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.167341:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.167349:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:1.0:1789778318.167351:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778318.167354:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c000, rc 0) 00000100:00100000:1.0:1789778318.167408:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:11639:x1876718296064384:12345-192.168.201.45@tcp:101:bash.0 Request processed in 11292us (11489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.167415:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 209 00000100:00100000:1.0:1789778318.172676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.172759:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296064768 00000100:00100000:0.0:1789778318.172769:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296064768 00000100:00100000:0.0:1789778318.172816:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:0.0:1789778318.172824:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+57:11639:x1876718296064768:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:0.0:1789778318.173098:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11639:x1876718296064768:12345-192.168.201.45@tcp:35:bash.0 Request processed in 274us (432us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789778318.173106:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 59 00000100:00100000:3.0:1789778318.232079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778318.232194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296064896 00000100:00100000:2.0:1789778318.232205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296064896 00000100:00100000:3.0:1789778318.232351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:3.0:1789778318.232361:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+58:11645:x1876718296064896:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778318.232388:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778318.232423:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e93 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.232485:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441bb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.232498:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.232506:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778318.232534:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789778318.232536:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789778318.232549:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.232566:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e93 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.232579:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e93 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.232584:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:3.0:1789778318.232586:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789778318.232589:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c800, rc 0) 00000100:00100000:3.0:1789778318.232887:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11645:x1876718296064896:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 524us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778318.232902:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 210 00000100:00100000:3.0:1789778318.235425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.235506:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296065024 00000100:00100000:0.0:1789778318.235516:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296065024 00000100:00100000:0.0:1789778318.235628:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:0.0:1789778318.235639:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11645:x1876718296065024:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778318.235657:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778318.235675:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441bb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7e9a expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235742:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235755:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235783:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235798:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235804:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235810:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235884:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235890:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235895:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778318.235921:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789778318.235924:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778318.235935:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235943:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235948:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235960:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235964:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235967:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.235971:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235976:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235984:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778318.235985:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.235988:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.235991:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3200/0x5a1e1c1157441bc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236001:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236005:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236009:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236011:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f2c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778318.236016:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236020:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236024:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778318.236026:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778318.236027:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236030:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2c00/0x5a1e1c1157441bc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236055:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2800/0x5a1e1c1157441bb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 61 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236108:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 60 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.236113:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.236115:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778318.236116:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ec21f3e00, rc 0) 00000100:00100000:0.0:1789778318.236168:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11645:x1876718296065024:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 531us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778318.236176:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 211 00000100:00100000:1.0:1789778318.241035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.241363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778318.241534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296065280 00000100:00100000:2.0:1789778318.241546:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296065280 00000100:00100000:2.0:1789778318.241609:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:2.0:1789778318.241620:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11645:x1876718296065280:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778318.241650:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778318.241671:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441bd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ea1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.241772:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.241784:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.241796:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 61 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.241801:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.241828:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 61 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.241837:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 61 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778318.241846:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314925184:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778318.241921:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.241929:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 61 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778318.241938:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec1768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314925312:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778318.241960:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778318.242511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296065408 00000100:00100000:3.0:1789778318.242517:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296065408 00010000:00010000:3.0:1789778318.242539:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 62 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778318.242567:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:3.0:1789778318.242575:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95638450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:2375:x1876718296065408:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778318.242584:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778318.242590:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 62 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.242600:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 62 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.242614:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778318.242617:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.243385:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.243403:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778318.243569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95638450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:2375:x1876718296065408:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 993us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778318.243577:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:1.0:1789778318.244984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.245023:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296065536 00000100:00100000:0.0:1789778318.245031:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296065536 00010000:00010000:3.0:1789778318.245089:0:5847:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.45@tcp) returned -22 from blocking AST (req@00000000ba7495c5 x1876718314925184) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 62 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.245092:0:12471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 62 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.245107:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3e00/0x5a1e1c1157441bce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e9a expref: 62 pid: 8093 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778318.245123:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314925184:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778318.245145:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1789778318.245146:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec1768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314925312:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778318.245153:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:2375:x1876718296065536:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778318.245166:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.245166:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778318.245171:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.245172:0:12471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 61 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.245236:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.245249:0:12471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 61 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.246975:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.247000:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c000/0x5a1e1c1157441ba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e8c expref: 61 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.247558:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778318.247565:0:12471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.247575:0:12471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.247582:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.247750:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778318.247806:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:2375:x1876718296065536:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2650us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.247816:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00010000:00010000:3.0:1789778318.247882:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.247890:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778318.247909:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789778318.248029:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8a00/0x5a1e1c1157441bd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.248508:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.248530:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778318.248532:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789778318.248535:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f9000, rc 0) 00000100:00100000:3.0:1789778318.248574:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11645:x1876718296065280:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 6956us (7550us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789778318.248581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 212 00000100:00100000:2.0:1789778318.251866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778318.251915:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296065792 00000100:00100000:3.0:1789778318.251925:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296065792 00000100:00100000:3.0:1789778318.251978:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778318.251988:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11645:x1876718296065792:12345-192.168.201.45@tcp:103:lfs.0 00010000:00010000:3.0:1789778318.252003:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778318.252027:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3400/0x5a1e1c1157441b3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e77 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.252042:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778318.252047:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778318.252137:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11645:x1876718296065792:12345-192.168.201.45@tcp:103:lfs.0 Request processed in 144us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778318.252149:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1789778318.253283:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778318.253319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296065920 00000100:00100000:3.0:1789778318.253327:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296065920 00000100:00100000:3.0:1789778318.253382:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:3.0:1789778318.253405:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11645:x1876718296065920:12345-192.168.201.45@tcp:58:lfs.0 00010000:00010000:3.0:1789778318.253511:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.253530:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.253538:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789778318.253703:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789778318.253771:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11645:x1876718296065920:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 379us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778318.253778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 213 00000100:00100000:0.0:1789778318.255464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.255526:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296066048 00000100:00100000:1.0:1789778318.255534:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296066048 00000100:00100000:1.0:1789778318.255573:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 214 00000100:00100000:1.0:1789778318.255579:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+59:11645:x1876718296066048:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778318.255593:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778318.255607:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ea8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.255658:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.255665:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.255678:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.255687:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.255702:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:1.0:1789778318.255714:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778318.255717:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.255722:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321400, rc 0) 00000100:00100000:1.0:1789778318.255766:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11645:x1876718296066048:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 187us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.255770:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 214 00000040:00080000:1.0:1789778318.769936:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789778318.769944:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789778318.770146:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789778318.770152:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789778318.770265:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314925440:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789778318.770367:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0117000 going to sleep for 11 seconds 00000100:00100000:0.0:1789778318.791001:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314925440:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789778318.792948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.792990:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296066176 00000100:00100000:1.0:1789778318.792998:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296066176 00000100:00100000:1.0:1789778318.793327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:1.0:1789778318.793339:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11646:x1876718296066176:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789778318.794016:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789778318.794927:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11646:x1876718296066176:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 1585us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.794938:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 215 00000100:00100000:2.0:1789778318.813322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.813633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296066304 00000100:00100000:1.0:1789778318.813642:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296066304 00000100:00100000:1.0:1789778318.813712:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:1.0:1789778318.813722:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11646:x1876718296066304:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789778318.813824:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813842:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813854:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813872:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813879:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813884:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813922:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813930:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813936:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778318.813972:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789778318.813976:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778318.813988:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.813999:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814012:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814019:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814025:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778318.814030:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814039:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814051:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:1.0:1789778318.814053:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778318.814058:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814088:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441bf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814103:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814109:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814114:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814119:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778318.814127:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814145:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814154:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b3e91b87800) 00010000:00010000:1.0:1789778318.814156:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778318.814159:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814165:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441bff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814181:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814187:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814192:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814196:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778318.814199:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814204:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814211:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:1.0:1789778318.814222:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778318.814233:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.814239:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.814323:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11646:x1876718296066304:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 602us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.814331:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 216 00000100:00100000:2.0:1789778318.821312:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778318.821802:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296066560 00000100:00100000:3.0:1789778318.821814:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296066560 00000100:00100000:3.0:1789778318.821874:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:3.0:1789778318.821885:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+60:11646:x1876718296066560:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778318.821917:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778318.821938:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7eaf expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822104:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822122:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822134:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778318.822145:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789778318.822260:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822286:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822293:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822300:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778318.822305:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822313:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822326:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778318.822329:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789778318.822334:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822356:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822409:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c0d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eaf expref: 62 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822420:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:3.0:1789778318.822422:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789778318.822426:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eaf expref: 62 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.822436:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44ce00, rc 0) 00000100:00100000:3.0:1789778318.823052:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:11646:x1876718296066560:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1166us (1750us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1789778318.823061:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 217 00000100:00100000:2.0:1789778318.831843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.831997:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296066688 00000100:00100000:1.0:1789778318.832008:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296066688 00000100:00100000:1.0:1789778318.832111:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:1.0:1789778318.832122:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:11646:x1876718296066688:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789778318.832170:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789778318.832270:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:11646:x1876718296066688:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 149us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.832284:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 218 00000100:00100000:2.0:1789778318.836242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.836662:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296066944 00000100:00100000:1.0:1789778318.836673:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296066944 00000100:00100000:3.0:1789778318.836855:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:3.0:1789778318.836869:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:11646:x1876718296066944:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778318.836894:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778318.836897:0:8093:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789778318.836925:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441bb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e93 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.836945:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:3.0:1789778318.836949:0:8093:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778318.836963:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c22 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7eb6 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789778318.837436:0:8093:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789778318.837935:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.837949:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.837959:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.838012:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c22 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eb6 expref: 63 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.838027:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eb6 expref: 62 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.838047:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e82bb5200) 00010000:00010000:3.0:1789778318.838049:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778318.838052:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d600, rc 0) 00000100:00100000:3.0:1789778318.838204:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:11646:x1876718296066944:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 1338us (1971us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789778318.838212:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 219 00000100:00100000:2.0:1789778318.850973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.851185:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296067200 00000100:00100000:1.0:1789778318.851196:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296067200 00000100:00100000:1.0:1789778318.851308:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:1.0:1789778318.851321:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:11646:x1876718296067200:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789778318.851428:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778318.851465:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44d600/0x5a1e1c1157441c29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eb6 expref: 62 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851484:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e82bb5200) 00010000:00010000:1.0:1789778318.851514:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778318.851539:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851553:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851562:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851606:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851614:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851620:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851681:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851689:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851696:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851701:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778318.851705:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851713:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851731:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:1.0:1789778318.851734:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778318.851738:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851744:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321200/0x5a1e1c1157441c37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851753:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851759:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851765:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851770:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778318.851772:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851778:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851786:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x469a2d37 (ffff9b3e91b87800) 00010000:00010000:1.0:1789778318.851788:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778318.851791:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.851797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x469a2d37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.851917:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:11646:x1876718296067200:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 598us (953us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789778318.851925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 220 00000100:00100000:2.0:1789778318.855642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.855744:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296067328 00000100:00100000:1.0:1789778318.855755:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296067328 00000100:00100000:1.0:1789778318.856311:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:1.0:1789778318.856324:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+61:11646:x1876718296067328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778318.856585:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778318.856611:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441c45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ebd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.856651:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.856665:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.856677:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.856778:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321e00/0x5a1e1c1157441c45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.856851:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.856861:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:1.0:1789778318.856870:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789778318.856874:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320600, rc 0) 00000100:00100000:1.0:1789778318.857085:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:11646:x1876718296067328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 745us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.857093:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 221 00000100:00100000:2.0:1789778318.868615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778318.868848:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296067584 00000100:00100000:3.0:1789778318.868858:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296067584 00000100:00100000:3.0:1789778318.868929:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:3.0:1789778318.868940:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+62:11646:x1876718296067584:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789778318.869024:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.869041:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.869052:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789778318.869402:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1789778318.869412:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373827346698ns, next at 374827344381ns, rc = 0 00000004:00010000:3.0:1789778318.869497:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a8dd6d4 reply state 00000000ec8d7a26 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778318.869515:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778318.872041:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+64:11646:x1876718296067584:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 3079us (3418us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789778318.872053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 222 00000100:00100000:2.0:1789778318.875722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.875997:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296067712 00000100:00100000:0.0:1789778318.876011:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296067712 00000100:00100000:0.0:1789778318.876104:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 223 00000100:00100000:0.0:1789778318.876114:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+64:11646:x1876718296067712:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778318.876138:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778318.876156:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ec4 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.876211:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 65 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.876225:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 65 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.876243:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:0.0:1789778318.876246:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778318.876250:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757200, rc 0) 00000100:00100000:0.0:1789778318.876308:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+65:11646:x1876718296067712:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 196us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778318.876334:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 223 00010000:00010000:3.0:1789778318.878886:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.879058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778318.879157:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296067840 00000100:00100000:2.0:1789778318.879168:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296067840 00010000:00010000:3.0:1789778318.879288:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.879297:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.879303:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44ce00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778318.879308:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.879316:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.879332:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:3.0:1789778318.879335:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789778318.879340:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778318.879347:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441c53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778318.880018:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1789778318.880029:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2375:x1876718296067840:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789778318.880343:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2375:x1876718296067840:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 315us (1290us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789778318.880351:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1789778318.883638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.883753:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296068096 00000100:00100000:0.0:1789778318.883764:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296068096 00000100:00100000:0.0:1789778318.883865:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:0.0:1789778318.883876:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+64:11646:x1876718296068096:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1789778318.883923:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778318.884299:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+65:11646:x1876718296068096:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 424us (667us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789778318.884307:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 60 00000100:00100000:3.0:1789778318.886556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.887929:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296068352 00000100:00100000:1.0:1789778318.887942:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296068352 00000100:00100000:1.0:1789778318.888018:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:1.0:1789778318.888029:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+65:11646:x1876718296068352:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789778318.888189:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+65:11646:x1876718296068352:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 161us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.888198:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 224 00000100:00100000:3.0:1789778318.891536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.891657:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296068480 00000100:00100000:0.0:1789778318.891678:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296068480 00000100:00100000:0.0:1789778318.891735:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 225 00000100:00100000:0.0:1789778318.891746:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+65:11646:x1876718296068480:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778318.891769:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778318.891794:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441c61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ecb expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.891867:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441c68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.891882:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.891895:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778318.891933:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778318.891953:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.891983:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c1157441c61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ecb expref: 67 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.891996:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ecb expref: 66 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.892003:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:0.0:1789778318.892005:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789778318.892007:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756c00, rc 0) 00000100:00100000:0.0:1789778318.892088:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+66:11646:x1876718296068480:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 344us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778318.892104:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 225 00000100:00100000:3.0:1789778318.894611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778318.894676:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296068608 00000100:00100000:2.0:1789778318.894685:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296068608 00000100:00100000:2.0:1789778318.894743:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1789778318.894873:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+10:2375:x1876718296068608:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778318.894900:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778318.894922:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ed2 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778318.894945:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadd98f, blocks: 0x1 00010000:00010000:2.0:1789778318.894967:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1789778318.894972:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778318.894995:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.895015:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.895029:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8a00, rc 0) 00000100:00100000:2.0:1789778318.895118:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:2375:x1876718296068608:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 365us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778318.895124:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:3.0:1789778318.901732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778318.902027:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296068864 00000100:00100000:2.0:1789778318.902039:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296068864 00000100:00100000:2.0:1789778318.902565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:2.0:1789778318.902581:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+66:11646:x1876718296068864:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789778318.903255:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+66:11646:x1876718296068864:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 678us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778318.903264:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 226 00000100:00100000:3.0:1789778318.914111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.914309:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296068992 00000100:00100000:0.0:1789778318.914320:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296068992 00000100:00100000:0.0:1789778318.914649:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:0.0:1789778318.914661:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:11646:x1876718296068992:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778318.914678:0:8205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778318.914696:0:8205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ed9 expref: -99 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.914732:0:8205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 12 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.914742:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778318.914746:0:8205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778318.914765:0:8205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 12 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.914798:0:8205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 12 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.914811:0:8205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 12 pid: 6694 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778318.914825:0:8205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8205:1876718314925568:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778318.914932:0:8205:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789778318.919037:0:8205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8205:1876718314925568:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778318.919448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00010000:00010000:0.0:1789778318.919587:0:8205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 12 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778318.919608:0:8205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756600, rc 0) 00000100:00100000:0.0:1789778318.919674:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf47c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:11646:x1876718296068992:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 5016us (5607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778318.919693:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:1.0:1789778318.919787:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296069120 00000100:00100000:1.0:1789778318.919794:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296069120 00010000:00010000:1.0:1789778318.919828:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 12 pid: 6694 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.919871:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:1.0:1789778318.919881:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:2375:x1876718296069120:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778318.919893:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778318.919916:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 12 pid: 6694 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.919930:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 12 pid: 6694 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.919966:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097631c31/0x5a1e1c1157441c6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed2 expref: 12 pid: 6694 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.919981:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778318.919985:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778318.919993:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 11 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.920003:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 11 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778318.920197:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 11 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778318.920211:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876718314925696:192.168.201.45@tcp:105: 00000100:00100000:1.0:1789778318.920261:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0117480 going to sleep for 11 seconds 00000100:00100000:1.0:1789778318.922757:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876718314925696:192.168.201.45@tcp:105: 00010000:00010000:1.0:1789778318.922783:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778318.922837:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:2375:x1876718296069120:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 2956us (3950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778318.922847:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:3.0:1789778318.929402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778318.929747:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296069248 00000100:00100000:0.0:1789778318.929759:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296069248 00002000:00100000:0.0:1789778318.929810:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b3d813f6300 x1876718296069248/t0(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:244/0 lens 504/0 e 0 to 0 dl 1789778329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789778318.929822:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3d813f6300 with x1876718296069248 ext(0->12) 00002000:00010000:0.0:1789778318.929829:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3d813f6300 00000100:00100000:0.0:1789778318.929866:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778318.929876:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+11:2374:x1876718296069248:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789778318.930645:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:2374:x1876718296069248:12345-192.168.201.45@tcp:4:lhsmtool_posix.0 Request processed in 766us (1258us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789778318.930655:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00002000:00100000:0.0:1789778318.930664:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b3d813f6300 x1876718296069248/t4294967321(0) o4->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:244/0 lens 504/448 e 0 to 0 dl 1789778329 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789778318.930673:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3d813f6300 with x1876718296069248 ext(0->12) 00002000:00010000:0.0:1789778318.930677:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3d813f6300 00000100:00100000:2.0:1789778318.934907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778318.934966:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296069376 00000100:00100000:1.0:1789778318.934978:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296069376 00000100:00100000:1.0:1789778318.935239:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:1.0:1789778318.935262:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+66:11646:x1876718296069376:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789778318.993414:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1789778318.993477:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789778318.993510:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3ea0367e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789778318.993515:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3ebdbc7c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3ea0367540 00000020:00080000:2.0:1789778318.993518:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3ebdbc7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3e91fad000 00000020:00080000:2.0:1789778318.993563:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3ebfb63540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789778318.993566:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e81328b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3ebfb63e40 00000020:00080000:2.0:1789778318.993584:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3e81328c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3eb9555800 00000004:00080000:2.0:1789778318.993595:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:2.0:1789778318.993627:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1789778318.993652:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789778318.993864:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789778318.993999:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314925952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789778318.994106:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778318.994147:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778318.994153:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec0eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314925824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789778318.994176:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778318.994205:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314925952 00000100:00100000:2.0:1789778318.994213:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314925952 00000100:00100000:2.0:1789778318.994258:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314925824 00000100:00100000:2.0:1789778318.994262:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314925824 00000100:00100000:2.0:1789778318.994284:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789778318.994293:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1876718314925952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789778318.994428:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789778318.994432:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789778319 00002000:00010000:2.0:1789778318.994435:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789778318.994436:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789778319 -> 1789778319 00002000:00010000:2.0:1789778318.994439:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789778318.994477:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1876718314925952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (371us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789778318.994485:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789778318.994502:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789778318.994509:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1876718314925824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789778318.994522:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789778318.994548:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.994568:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 12 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.994577:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789778318.994582:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778318.994587:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.994627:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 12 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.994643:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 12 pid: 8205 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778318.994654:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314926080:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778318.994713:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e91190780 going to sleep for 11 seconds 00000100:00080000:2.0:1789778318.994729:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789778318.994848:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec0eac380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789778318.994854:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314925952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789778318.995189:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778318.995206:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314926208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789778318.995236:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778318.996271:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314926208 00000100:00100000:2.0:1789778318.996282:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314926208 00000100:00100000:2.0:1789778318.996395:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789778318.996404:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876718314926208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789778318.996430:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789778318.996530:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aadd98d, atime: 0x6aadd98e, ctime: 0x6aadd98d, blocks: 0x1 00010000:00010000:2.0:1789778318.996539:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.996555:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1789778318.996559:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778318.996566:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.996583:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.996593:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.996601:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778318.996617:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789778318.998162:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11646:x1876718296069376:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 62894us (63262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778318.998186:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 227 00000100:00100000:3.0:1789778319.000617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778319.000936:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1876718314926208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4530us (5695us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789778319.000948:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1789778319.000986:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778319.000995:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.001010:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778319.002257:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.002273:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.002296:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.002304:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.002329:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778319.002330:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778319.002332:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778319.002356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296069504 00000100:00100000:2.0:1789778319.002365:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296069504 00010000:00010000:2.0:1789778319.002411:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 13 pid: 8205 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778319.002448:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000004:00080000:3.0:1789778319.002639:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec16d2680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789778319.002646:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314926208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789778319.002773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778319.003565:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296069632 00000100:00100000:1.0:1789778319.003573:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296069632 00000100:00100000:1.0:1789778319.003612:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:1.0:1789778319.003621:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2373:x1876718296069632:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789778319.003710:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314926080:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778319.003732:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778319.003875:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+14:2375:x1876718296069504:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778319.003890:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778319.003897:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 14 pid: 8205 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.003910:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 14 pid: 8205 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.003938:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000508c104/0x5a1e1c1157441a3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e38 expref: 14 pid: 8205 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.003950:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778319.003954:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778319.003959:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.003968:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.003991:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778319.004055:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+13:2375:x1876718296069504:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 184us (3447us total) trans 0 rc 0/0 00000100:00080000:0.0:1789778319.004122:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778319.004652:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00010000:00010000:2.0:1789778319.004789:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.004801:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.004811:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.004819:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.004851:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789778319.006311:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778319.006323:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.006335:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778319.006340:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.006350:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.006369:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.006376:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c3955cd/0x5a1e1c1157441c7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.006411:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778319.006413:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778319.006414:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778319.007633:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1876718314925824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13115us (13446us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789778319.007647:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1789778319.008343:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec0eaf800/2, rc 0, transno 4294967323 00000100:00100000:3.0:1789778319.008354:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec0eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314925824:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789778319.025453:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778319.040083:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+12:2373:x1876718296069632:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 36428us (37276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778319.040097:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:3.0:1789778319.044045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778319.044369:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296069888 00000100:00100000:1.0:1789778319.044388:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296069888 00000100:00100000:1.0:1789778319.044475:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 228 00000100:00100000:1.0:1789778319.044488:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11646:x1876718296069888:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789778319.044558:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778319.044599:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441c68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ecb expref: 20 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.044626:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:1.0:1789778319.044633:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778319.044691:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.044725:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.044758:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789778319.046295:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087deffbf reply state 00000000137adefd transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778319.046317:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789778319.046474:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:11646:x1876718296069888:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 1984us (2447us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789778319.046483:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 228 00000001:00080000:0.0:1789778319.046593:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1789778319.046623:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:3.0:1789778319.049357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778319.049993:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296070016 00000100:00100000:1.0:1789778319.050006:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296070016 00000100:00100000:1.0:1789778319.050087:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 70 00000100:00100000:1.0:1789778319.050099:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2373:x1876718296070016:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789778319.050343:0:8205:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789778319.050347:0:8205:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789778319 -> 1789778318 00002000:00010000:1.0:1789778319.050350:0:8205:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789778318 00002000:00010000:1.0:1789778319.050353:0:8205:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789778319 -> 1789778318 00002000:00010000:1.0:1789778319.050355:0:8205:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789778319.050425:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2373:x1876718296070016:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 328us (1089us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789778319.050434:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 70 00010000:00010000:0.0:1789778319.050593:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.050603:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.050625:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.050631:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778319.050636:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.050644:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.050660:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:0.0:1789778319.050664:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778319.050669:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.050676:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320800/0x5a1e1c1157441c8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778319.054020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778319.054271:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296070272 00000100:00100000:0.0:1789778319.054282:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296070272 00000100:00100000:0.0:1789778319.054332:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:0.0:1789778319.054343:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:11646:x1876718296070272:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789778319.054449:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.054467:0:8093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.054475:0:8093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.054536:0:8093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.054552:0:8093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 20 pid: 5845 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778319.054566:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314926336:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778319.054744:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec1777c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778319.058060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778319.060477:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8093:1876718314926336:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778319.060514:0:8093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778319.060607:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296070400 00000100:00100000:2.0:1789778319.060615:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296070400 00010000:00010000:1.0:1789778319.060814:0:12471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 21 pid: 5845 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778319.060876:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:1.0:1789778319.060886:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:2375:x1876718296070400:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778319.060904:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778319.060911:0:12471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 21 pid: 5845 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.060924:0:12471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 21 pid: 5845 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.060946:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441c4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ebd expref: 21 pid: 5845 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.060960:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:1.0:1789778319.060965:0:12471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.060974:0:12471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.060980:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.061014:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778319.061101:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:2375:x1876718296070400:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 216us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778319.061110:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00010000:00010000:2.0:1789778319.061285:0:8093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061294:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061322:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061330:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061337:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061344:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778319.061347:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061355:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061363:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:2.0:1789778319.061373:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789778319.061388:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.061396:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441c92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778319.061437:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11646:x1876718296070272:12345-192.168.201.45@tcp:55:lhsmtool_posix.0 Request processed in 7096us (7428us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789778319.061445:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 229 00000100:00100000:1.0:1789778319.064306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778319.064397:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296070528 00000100:00100000:2.0:1789778319.064408:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296070528 00000100:00100000:2.0:1789778319.064466:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:2.0:1789778319.064476:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2373:x1876718296070528:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789778319.064518:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.064539:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 8 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.064548:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789778319.064552:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789778319.064557:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.064592:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 8 pid: 8205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.064617:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 8 pid: 8205 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778319.064631:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314926464:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778319.064724:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e911900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778319.068469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778319.068582:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876718314926464:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778319.068611:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778319.068689:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296070656 00000100:00100000:0.0:1789778319.068697:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296070656 00010000:00010000:0.0:1789778319.068733:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 9 pid: 8205 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778319.068771:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:0.0:1789778319.068781:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+9:2374:x1876718296070656:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778319.068798:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778319.068823:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 9 pid: 8205 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.068836:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 9 pid: 8205 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.068879:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c1157441c76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ed9 expref: 9 pid: 8205 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.068896:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778319.068901:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778319.068906:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.068916:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.068948:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778319.069006:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2374:x1876718296070656:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 226us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778319.069014:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00010000:00010000:1.0:1789778319.069105:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069115:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069150:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069159:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069167:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069175:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778319.069179:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069188:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069202:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.069210:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000877f3bf4/0x5a1e1c1157441c99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778319.069273:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2373:x1876718296070528:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 4798us (4978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778319.069280:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 71 00000100:00100000:3.0:1789778319.074374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778319.074482:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296070912 00000100:00100000:2.0:1789778319.074493:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296070912 00000100:00100000:2.0:1789778319.074546:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 230 00000100:00100000:2.0:1789778319.074557:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11646:x1876718296070912:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789778319.074644:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.074665:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.074772:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.074971:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.074983:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 20 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.075003:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.075034:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 20 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.075048:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 20 pid: 8093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778319.075061:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314926592:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778319.075426:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e911900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778319.077824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778319.078155:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314926592:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778319.078182:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778319.078967:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296071040 00000100:00100000:1.0:1789778319.078977:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296071040 00010000:00010000:1.0:1789778319.079017:0:12471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 21 pid: 8093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778319.079284:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:1.0:1789778319.079294:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9563a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:2375:x1876718296071040:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778319.079311:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778319.079319:0:12471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 21 pid: 8093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.079331:0:12471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 21 pid: 8093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.079356:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441c5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ec4 expref: 21 pid: 8093 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.079372:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:1.0:1789778319.079388:0:12471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.079398:0:12471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.079423:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.079454:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778319.079515:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9563a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:2375:x1876718296071040:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 222us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778319.079523:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00010000:00010000:3.0:1789778319.079843:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778319.079852:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778319.080049:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789778319.080232:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789778319.080292:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789778319.080372:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876718314926720:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789778319.080432:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778319.080464:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778319.080527:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314926720 00000100:00100000:2.0:1789778319.080533:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314926720 00000100:00100000:2.0:1789778319.080576:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789778319.080585:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876718314926720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789778319.080649:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876718314926720:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778319.080655:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789778319.080805:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1789778319.080822:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1789778319.080839:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec0eac380, transno 4294967322 00000004:00080000:3.0:1789778319.080854:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec0eaf800, transno 4294967323 00000100:00100000:3.0:1789778319.080861:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876718314926720:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789778319.081287:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789778319.081333:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876718314926848:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789778319.081361:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778319.081375:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf4216c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778319.081723:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314926848 00000100:00100000:2.0:1789778319.081728:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314926848 00000100:00100000:2.0:1789778319.081760:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789778319.081767:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876718314926848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789778319.081891:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1876718314926848:12345-0@lo:1000:mdt00_002.0 Request processed in 125us (529us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789778319.081898:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789778319.081930:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876718314926848:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789778319.081970:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.081978:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.081985:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.081991:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778319.081996:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082004:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082024:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3e91b87900) 00010000:00010000:2.0:1789778319.082027:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789778319.082031:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082037:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9400/0x5a1e1c1157441ca7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082084:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082092:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082098:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082112:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44ca00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778319.082116:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082122:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082131:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:2.0:1789778319.082133:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789778319.082140:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082150:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082159:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.082181:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778319.082191:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314926976:192.168.201.45@tcp:105: 00000100:00100000:2.0:1789778319.082244:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e91190780 going to sleep for 11 seconds 00000100:00100000:3.0:1789778319.085778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778319.085914:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296071168 00000100:00100000:2.0:1789778319.085924:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296071168 00000100:00100000:2.0:1789778319.085985:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1789778319.085996:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11645:x1876718296071168:12345-192.168.201.45@tcp:49:lfs.0 00000100:00100000:2.0:1789778319.086181:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11645:x1876718296071168:12345-192.168.201.45@tcp:49:lfs.0 Request processed in 187us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778319.086189:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 61 00000100:00100000:2.0:1789778319.086517:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876718314926976:192.168.201.45@tcp:105: 00010000:00010000:2.0:1789778319.086806:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086817:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ca00/0x5a1e1c1157441bea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086846:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086859:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086872:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086880:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086886:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086893:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086898:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778319.086901:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086916:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086928:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:2.0:1789778319.086931:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778319.086935:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086939:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8200/0x5a1e1c1157441cae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086950:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086954:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086959:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086963:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778319.086966:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086970:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086976:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:2.0:1789778319.086978:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789778319.086981:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778319.086995:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8400/0x5a1e1c1157441ca0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778319.088944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778319.089034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296071424 00000100:00100000:0.0:1789778319.089043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296071424 00000100:00100000:0.0:1789778319.089112:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 231 00000100:00100000:0.0:1789778319.089122:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11645:x1876718296071424:12345-192.168.201.45@tcp:58:lfs.0 00000100:00100000:2.0:1789778319.090121:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+24:11646:x1876718296070912:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 15561us (15753us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789778319.090132:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 230 00000020:00080000:2.0:1789778319.090137:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789778319.090272:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778319.090276:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789778319.091182:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789778319.091256:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:11645:x1876718296071424:12345-192.168.201.45@tcp:58:lfs.0 Request processed in 2132us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778319.091264:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 231 00000040:00080000:2.0:1789778319.096152:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789778319.096173:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789778319.100991:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778319.101161:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296071680 00000100:00100000:0.0:1789778319.101172:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296071680 00000100:00100000:0.0:1789778319.101242:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 62 00000100:00100000:0.0:1789778319.101252:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86776c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+23:11646:x1876718296071680:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789778319.101971:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789778319.102331:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1789778319.102387:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.102404:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.102416:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.102425:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.102432:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.102439:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.103421:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789778319.103546:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86776c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+25:11646:x1876718296071680:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 2290us (2559us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789778319.103556:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 62 00000020:00080000:0.0:1789778319.103563:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789778319.110942:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778319.110958:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.110970:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778319.110975:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.110985:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.111004:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:1.0:1789778319.111007:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789778319.111012:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.111031:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441cb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.111306:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778319.111310:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778319.111312:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778319.130644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778319.130886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296071808 00000100:00100000:1.0:1789778319.130896:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296071808 00000100:00100000:1.0:1789778319.130994:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 232 00000100:00100000:1.0:1789778319.131005:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+25:11648:x1876718296071808:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:1.0:1789778319.131048:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778319.131104:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441cbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ee0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131185:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131201:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131213:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131229:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131236:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131243:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131479:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131491:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131499:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131534:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778319.131555:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 26 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778319.131570:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314927104:192.168.201.45@tcp:104: 00000100:00100000:1.0:1789778319.131653:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ea0117e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789778319.136931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778319.137002:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296072064 00000100:00100000:3.0:1789778319.137040:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296072064 00000100:00100000:3.0:1789778319.137124:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:3.0:1789778319.137151:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:9271:x1876718296072064:12345-192.168.201.45@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789778319.137397:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:9271:x1876718296072064:12345-192.168.201.45@tcp:35:ldlm_bl.0 Request processed in 263us (477us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789778319.137405:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 63 00000100:00100000:2.0:1789778319.140191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778319.140321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296072192 00000100:00100000:0.0:1789778319.140332:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296072192 00010000:00010000:0.0:1789778319.140369:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 28 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778319.140419:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:0.0:1789778319.140429:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:2374:x1876718296072192:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778319.140444:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778319.140451:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 28 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.140465:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 28 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.140490:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778319.140496:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.140505:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.140514:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.140534:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778319.140599:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:2374:x1876718296072192:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 170us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778319.140607:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00010000:00010000:1.0:1789778319.142993:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9000/0x5a1e1c1157441bdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea1 expref: 27 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778319.143016:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876718314927104:192.168.201.45@tcp:104: 00010000:00010000:1.0:1789778319.143253:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143319:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143327:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778319.143371:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789778319.143385:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778319.143408:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143422:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143431:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143438:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143445:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143451:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778319.143456:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143463:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143476:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:0.0:1789778319.143479:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778319.143484:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143507:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321a00/0x5a1e1c1157441cc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143519:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143525:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143530:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143535:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778319.143538:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143543:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143551:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b3e91b87800) 00010000:00010000:0.0:1789778319.143554:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778319.143557:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143563:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321c00/0x5a1e1c1157441cca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143602:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320600/0x5a1e1c1157441cbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ee0 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143615:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ee0 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778319.143632:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778319.143634:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778319.143636:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82321000, rc 0) 00000100:00100000:0.0:1789778319.143729:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11648:x1876718296071808:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 12725us (13096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778319.143737:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 232 00000040:00080000:1.0:1789778319.843989:0:12563:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789778319.843998:0:12563:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789778319.844042:0:12563:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789778319.844048:0:12563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789778319.857324:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789778319.857340:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789778319.857348:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1789778320.055801:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789778320.113348:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778320.113357:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778320.113410:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789778320.113416:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789778320.113559:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314927232:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789778320.113673:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e91190e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778320.122913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778320.123138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296072320 00000100:00100000:0.0:1789778320.123149:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296072320 00000100:00100000:0.0:1789778320.123232:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:0.0:1789778320.123243:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+27:11660:x1876718296072320:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789778320.123350:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1789778320.123570:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778320.126783:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1876718314927232:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789778320.127226:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11660:x1876718296072320:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 3982us (4320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778320.127238:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 233 00000100:00100000:0.0:1789778320.134912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778320.135173:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296072576 00000100:00100000:3.0:1789778320.135185:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296072576 00000100:00100000:3.0:1789778320.135246:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:3.0:1789778320.135257:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+26:11660:x1876718296072576:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778320.135290:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778320.135309:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441cd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ee7 expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.135416:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441cdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.135437:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.135449:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441cdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778320.135461:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789778320.135585:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44ce00/0x5a1e1c1157441cd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ee7 expref: 29 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.135602:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441cdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ee7 expref: 28 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.135611:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778320.135614:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789778320.135617:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c800, rc 0) 00000100:00100000:3.0:1789778320.135700:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:11660:x1876718296072576:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 444us (798us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789778320.135707:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 234 00000100:00100000:1.0:1789778320.143183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778320.143268:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296072832 00000100:00100000:3.0:1789778320.143278:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296072832 00000100:00100000:3.0:1789778320.143327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 235 00000100:00100000:3.0:1789778320.143350:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:11660:x1876718296072832:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789778320.143447:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143465:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143479:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143687:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143695:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143702:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143708:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44da00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778320.143712:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143719:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143732:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778320.143735:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789778320.143738:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778320.143744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441ced lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778320.143901:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:11660:x1876718296072832:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 553us (726us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789778320.143910:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 235 00000040:00080000:2.0:1789778320.144146:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789778320.144151:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789778320.144654:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789778320.144662:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789778320.148302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778320.148514:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296072960 00000100:00100000:0.0:1789778320.148525:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296072960 00000100:00100000:0.0:1789778320.148585:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:0.0:1789778320.148596:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:2375:x1876718296072960:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778320.148612:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778320.148636:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c800/0x5a1e1c1157441cdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ee7 expref: 29 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778320.148666:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778320.148685:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778320.148741:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:2375:x1876718296072960:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 146us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778320.148748:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:1.0:1789778320.159040:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778320.159189:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296073216 00000100:00100000:3.0:1789778320.159200:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296073216 00000100:00100000:3.0:1789778320.159260:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:3.0:1789778320.159271:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+28:11660:x1876718296073216:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789778320.159512:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:11660:x1876718296073216:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 241us (481us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789778320.159520:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 64 00000100:00100000:2.0:1789778320.305446:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789778320.305481:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314927360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778320.305656:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778320.305879:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314927360 00000100:00100000:1.0:1789778320.305897:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314927360 00000100:00100000:1.0:1789778320.305966:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789778320.305976:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314927360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789778320.306016:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778320.306079:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314927360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778320.306085:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789778320.306115:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789778320.306120:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec16fbb80, transno 4294967307 00000004:00080000:1.0:1789778320.306131:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789778320.306148:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec16d2680, transno 4294967310 00000100:00100000:1.0:1789778320.306158:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314927360:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789778320.306797:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778320.309297:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314927488:0@lo:400:kworker.0 00000100:00100000:1.0:1789778320.309383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778320.309914:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314927488 00000100:00100000:2.0:1789778320.309925:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314927488 00000100:00100000:2.0:1789778320.309991:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789778320.310001:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314927488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.312103:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314927616:0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.312166:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778320.312232:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314927616 00000100:00100000:0.0:1789778320.312239:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314927616 00000100:00100000:0.0:1789778320.312282:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789778320.312291:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314927616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.312336:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314927616:12345-0@lo:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778320.312343:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789778320.312398:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314927616:0@lo:400:kworker.0 00000100:00100000:2.0:1789778320.315153:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314927488:12345-0@lo:400:kworker.0 Request processed in 5144us (5760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778320.315169:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789778320.315592:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314927872:0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.315646:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778320.315798:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778320.315805:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314927744:0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.315830:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778320.315855:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789778320.315861:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314928000:0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.315886:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778320.315917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314927872 00000100:00100000:0.0:1789778320.315924:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314927872 00000100:00100000:0.0:1789778320.315969:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314927744 00000100:00100000:0.0:1789778320.315973:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314927744 00000100:00100000:0.0:1789778320.316011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789778320.316019:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314927872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.316081:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314927872:12345-0@lo:400:kworker.0 Request processed in 45us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778320.316088:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789778320.316100:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789778320.316107:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314927744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.316134:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876718314927744:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778320.316140:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1789778320.316158:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778320.316183:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876718314927744:0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.316192:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314927872:0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.316230:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928000 00000100:00100000:0.0:1789778320.316234:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928000 00000100:00100000:0.0:1789778320.316264:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789778320.316271:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314928000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778320.316302:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314928000:12345-0@lo:400:kworker.0 Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778320.316308:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789778320.316321:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778320.316335:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314928000:0@lo:400:kworker.0 00000100:00100000:1.0:1789778320.317999:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314927488:0@lo:400:kworker.0 00000100:00100000:2.0:1789778320.817389:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314928128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778320.817473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778320.817708:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928128 00000100:00100000:0.0:1789778320.817716:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928128 00000100:00100000:0.0:1789778320.817765:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789778320.817775:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314928128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778320.817824:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778320.817881:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314928128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778320.817889:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789778320.818037:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314928128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778321.082789:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778321.172530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778321.172571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778321.172601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778321.172620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778321.172706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778321.172732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296073856 00000100:00100000:1.0:1789778321.172741:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296073856 00000100:00100000:1.0:1789778321.172796:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296073472 00000100:00100000:1.0:1789778321.172798:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296073472 00000100:00100000:1.0:1789778321.172816:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:1.0:1789778321.172825:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718296073856:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778321.172892:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2372:x1876718296073856:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778321.172899:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 155 00000100:00100000:1.0:1789778321.172926:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:1.0:1789778321.172931:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:2372:x1876718296073472:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778321.172954:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:2372:x1876718296073472:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778321.172972:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 156 00000100:00100000:1.0:1789778321.172995:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296073600 00000100:00100000:1.0:1789778321.172998:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296073600 00000100:00100000:1.0:1789778321.173019:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296073728 00000100:00100000:1.0:1789778321.173022:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296073728 00000100:00100000:1.0:1789778321.173037:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:1.0:1789778321.173042:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2372:x1876718296073600:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778321.173090:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e88de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2372:x1876718296073600:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778321.173107:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:0.0:1789778321.173147:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296073344 00000100:00100000:0.0:1789778321.173151:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296073344 00000100:00100000:0.0:1789778321.173178:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 297 00000100:00100000:0.0:1789778321.173185:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718296073344:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778321.173212:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2372:x1876718296073344:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 28us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778321.173218:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 297 00000100:00100000:3.0:1789778321.173267:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:3.0:1789778321.173276:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296073728:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778321.173303:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296073728:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778321.173309:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00080000:3.0:1789778321.173353:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778321.173358:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789778321.173360:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789778321.802698:0:12614:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789778321.802709:0:12614:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789778321.802755:0:12614:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789778321.802762:0:12614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789778321.918889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778321.921746:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296074112 00000100:00100000:3.0:1789778321.921760:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296074112 00000100:00100000:3.0:1789778321.921820:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 236 00000100:00100000:3.0:1789778321.921830:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+29:11680:x1876718296074112:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778321.921849:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778321.921871:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441cf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7eee expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778321.921975:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441cfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778321.921989:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441cfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778321.922000:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441cfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789778321.922011:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789778321.922162:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44c400/0x5a1e1c1157441cf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eee expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778321.922178:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441cfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eee expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778321.922187:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778321.922190:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789778321.922194:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44da00, rc 0) 00000100:00100000:3.0:1789778321.922607:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:11680:x1876718296074112:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 776us (3725us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789778321.922615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 236 00000100:00100000:3.0:1789778321.932002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778321.932114:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296074240 00000100:00100000:0.0:1789778321.932126:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296074240 00000100:00100000:0.0:1789778321.932188:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 237 00000100:00100000:0.0:1789778321.932198:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:11680:x1876718296074240:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:0.0:1789778321.932271:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932288:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932300:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932323:0:8093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932348:0:8093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932361:0:8093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932367:0:8093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778321.932371:0:8093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932378:0:8093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932390:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778321.932393:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789778321.932398:0:8093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778321.932404:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c1157441d09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778321.932467:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+31:11680:x1876718296074240:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 270us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778321.932474:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 237 00000100:00100000:2.0:1789778322.029857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778322.030023:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296074368 00000100:00100000:3.0:1789778322.030034:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296074368 00000100:00100000:3.0:1789778322.030119:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:3.0:1789778322.030131:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2373:x1876718296074368:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:3.0:1789778322.030160:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778322.030181:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097c71784/0x5a1e1c1157441d10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ef5 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778322.030212:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aadd98e, atime: 0x6aadd98e, ctime: 0x6aadd98e, blocks: 0xb 00010000:00010000:3.0:1789778322.030233:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1789778322.030238:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778322.030247:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097c71784/0x5a1e1c1157441d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ef5 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778322.030266:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097c71784/0x5a1e1c1157441d10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ef5 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778322.030279:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c400, rc 0) 00000100:00100000:3.0:1789778322.030341:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2373:x1876718296074368:12345-192.168.201.45@tcp:101:cat.0 Request processed in 213us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778322.030349:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 72 00000100:00100000:0.0:1789778322.040364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778322.044708:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296074496 00000100:00100000:1.0:1789778322.044723:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296074496 00002000:00100000:1.0:1789778322.044775:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b3ec17a8a80 x1876718296074496/t0(0) o3->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:248/0 lens 488/0 e 0 to 0 dl 1789778333 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789778322.044787:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec17a8a80 with x1876718296074496 ext(0->4095) 00002000:00010000:1.0:1789778322.044792:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec17a8a80 00000100:00100000:1.0:1789778322.044822:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1789778322.044831:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2372:x1876718296074496:12345-192.168.201.45@tcp:3:cat.0 00000100:00100000:1.0:1789778322.045033:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+8:2372:x1876718296074496:12345-192.168.201.45@tcp:3:cat.0 Request processed in 202us (4680us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789778322.045041:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00002000:00100000:1.0:1789778322.045048:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b3ec17a8a80 x1876718296074496/t0(0) o3->bdd103b9-ae1a-4bf0-9cc3-bcece875c39a@192.168.201.45@tcp:248/0 lens 488/4536 e 0 to 0 dl 1789778333 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789778322.045056:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3ec17a8a80 with x1876718296074496 ext(0->4095) 00002000:00010000:1.0:1789778322.045059:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b3ec17a8a80 00010000:00010000:0.0:1789778322.097272:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778323.123757:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778324.145281:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789778324.562514:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1789778324.562528:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1789778324.604092:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:2.0:1789778324.604139:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1789778324.604151:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1789778324.604168:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3ebf421d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789778324.604174:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3eb9750e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3ebf421180 00000020:00080000:2.0:1789778324.604178:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b3eb9750500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3eb5dc1c00 00000020:00080000:3.0:1789778324.604811:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789778324.605018:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789778325.170995:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778325.425614:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778325.425636:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314928256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778325.425701:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778325.425841:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928256 00000100:00100000:3.0:1789778325.425859:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928256 00000100:00100000:3.0:1789778325.425922:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789778325.425932:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314928256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778325.425982:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778325.426024:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314928256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778325.426031:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789778325.426056:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314928384:0@lo:400:kworker.0 00000100:00100000:3.0:1789778325.426110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778325.426133:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314928896:0@lo:400:kworker.0 00000100:00100000:3.0:1789778325.426156:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778325.426194:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314928256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778325.426211:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778325.426216:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314928768:0@lo:400:kworker.0 00000100:00100000:3.0:1789778325.426240:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789778325.426272:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778325.429729:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928896 00000100:00100000:0.0:1789778325.429743:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928896 00000100:00100000:0.0:1789778325.429818:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789778325.429827:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314928896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778325.429921:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314928896:12345-0@lo:400:kworker.0 Request processed in 95us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778325.429934:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789778325.429953:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778325.429986:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789778325.429991:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789778325.430012:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314928896:0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.430587:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314928512:0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.430630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778325.430658:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778325.430665:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314928640:0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.430685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778325.430776:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928768 00000100:00100000:1.0:1789778325.430780:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928768 00000100:00100000:1.0:1789778325.430813:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928512 00000100:00100000:1.0:1789778325.430816:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928512 00000100:00100000:1.0:1789778325.430828:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928640 00000100:00100000:1.0:1789778325.430829:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928640 00000100:00100000:1.0:1789778325.430842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789778325.430848:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314928768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.430887:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314928768:12345-0@lo:400:kworker.0 Request processed in 39us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778325.430893:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789778325.430905:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789778325.430918:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314928512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.430949:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d813f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314928512:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778325.430955:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789778325.430966:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789778325.430971:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314928640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.430994:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314928640:12345-0@lo:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778325.430999:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789778325.431028:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314928640:0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.431037:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314928512:0@lo:400:kworker.0 00000100:00100000:2.0:1789778325.431655:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314928384 00000100:00100000:2.0:1789778325.431661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314928384 00000100:00100000:2.0:1789778325.431695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789778325.431702:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314928384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778325.431763:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3313:x1876718314928384:12345-0@lo:400:kworker.0 Request processed in 61us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778325.431769:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1789778325.433222:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778325.433261:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314928768:0@lo:400:kworker.0 00000100:00100000:0.0:1789778325.433287:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314928384:0@lo:400:kworker.0 00000100:00100000:1.0:1789778325.938227:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314929024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778325.938307:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778325.938479:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929024 00000100:00100000:3.0:1789778325.938487:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929024 00000100:00100000:3.0:1789778325.938541:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789778325.938551:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314929024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789778325.938586:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778325.938643:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314929024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778325.938651:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789778325.938830:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314929024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789778326.200662:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778326.292015:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778326.292042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778326.292096:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778326.292116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778326.292138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778326.292172:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296075136 00000100:00100000:1.0:1789778326.292181:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296075136 00000100:00100000:1.0:1789778326.292234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:1.0:1789778326.292246:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718296075136:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778326.292325:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2375:x1876718296075136:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778326.292332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 160 00000100:00100000:1.0:1789778326.292356:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296074752 00000100:00100000:1.0:1789778326.292359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296074752 00000100:00100000:1.0:1789778326.292381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:1.0:1789778326.292387:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:2375:x1876718296074752:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778326.292413:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:2375:x1876718296074752:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778326.292420:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 161 00000100:00100000:1.0:1789778326.292441:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296074880 00000100:00100000:1.0:1789778326.292445:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296074880 00000100:00100000:1.0:1789778326.292471:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296075008 00000100:00100000:1.0:1789778326.292473:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296075008 00000100:00100000:1.0:1789778326.292493:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1789778326.292500:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718296074880:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778326.292522:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2375:x1876718296074880:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778326.292528:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1789778326.292537:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:1.0:1789778326.292542:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296075008:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778326.292561:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2375:x1876718296075008:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 20us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778326.292566:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00080000:1.0:1789778326.292579:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789778326.292583:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789778326.292585:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778326.292778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296074624 00000100:00100000:0.0:1789778326.292783:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296074624 00000100:00100000:0.0:1789778326.292819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 299 00000100:00100000:0.0:1789778326.292826:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718296074624:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778326.292857:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2375:x1876718296074624:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 31us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778326.292863:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 299 00010000:00010000:1.0:1789778327.230648:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778327.369302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778327.369439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296075264 00000100:00100000:2.0:1789778327.369451:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296075264 00000100:00100000:2.0:1789778327.369520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 238 00000100:00100000:2.0:1789778327.369540:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:11334:x1876718296075264:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789778327.369749:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:11334:x1876718296075264:12345-192.168.201.45@tcp:60:lhsmtool_posix.0 Request processed in 218us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778327.369757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 238 00000100:00100000:0.0:1789778327.382441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778327.382700:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296075520 00000100:00100000:2.0:1789778327.382711:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296075520 00000100:00100000:2.0:1789778327.382769:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:2.0:1789778327.382780:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:11334:x1876718296075520:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789778327.383298:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:11334:x1876718296075520:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 519us (866us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789778327.383307:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 65 00000100:00100000:1.0:1789778327.691248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778327.691369:0:8093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296075648 00000100:00100000:0.0:1789778327.691378:0:8093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296075648 00000100:00100000:0.0:1789778327.691433:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 239 00000100:00100000:0.0:1789778327.691450:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:12132:x1876718296075648:12345-192.168.201.45@tcp:101:lsof.0 00010000:00010000:0.0:1789778327.691469:0:8093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778327.691489:0:8093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441d17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7efc expref: -99 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778327.691555:0:8093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441d1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778327.691576:0:8093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778327.691588:0:8093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778327.691623:0:8093:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789778327.691627:0:8093:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778327.691646:0:8093:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778327.691669:0:8093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756c00/0x5a1e1c1157441d17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7efc expref: 7 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778327.691685:0:8093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441d1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7efc expref: 6 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778327.691694:0:8093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:0.0:1789778327.691697:0:8093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778327.691700:0:8093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757e00, rc 0) 00000100:00100000:0.0:1789778327.691759:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:12132:x1876718296075648:12345-192.168.201.45@tcp:101:lsof.0 Request processed in 317us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778327.691766:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 239 00010000:00010000:2.0:1789778328.242083:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778328.370193:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789778328.370202:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778328.371919:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789778328.371929:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789778329.265578:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789778329.546497:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789778329.546514:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789778329.546569:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789778329.546583:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789778330.293575:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778330.545447:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314929152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778330.545520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778330.545629:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929152 00000100:00100000:2.0:1789778330.545637:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929152 00000100:00100000:2.0:1789778330.545686:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789778330.545694:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314929152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778330.545727:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778330.545887:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314929152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778330.545895:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789778330.545941:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314929152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778330.549392:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314929280:0@lo:400:kworker.0 00000100:00100000:2.0:1789778330.549476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778330.549526:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789778330.549531:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314929408:0@lo:400:kworker.0 00000100:00100000:2.0:1789778330.549556:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778330.550327:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929280 00000100:00100000:3.0:1789778330.550338:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929280 00000100:00100000:3.0:1789778330.550417:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789778330.550576:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314929536:0@lo:400:kworker.0 00000100:00100000:1.0:1789778330.550640:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778330.550740:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314929280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778330.550926:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314929280:12345-0@lo:400:kworker.0 Request processed in 187us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778330.551058:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314929280:0@lo:400:kworker.0 00000100:00080000:2.0:1789778330.551234:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789778330.551274:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789778330.551322:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929408 00000100:00100000:3.0:1789778330.551326:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929408 00000100:00100000:3.0:1789778330.551400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929536 00000100:00100000:3.0:1789778330.551404:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929536 00000100:00100000:2.0:1789778330.551477:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789778330.551487:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314929408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778330.551534:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314929408:12345-0@lo:400:kworker.0 Request processed in 49us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778330.551539:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789778330.551553:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789778330.551559:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314929536:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789778330.551614:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778330.551642:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314929408:0@lo:400:kworker.0 00000100:00100000:3.0:1789778330.552280:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314929664:0@lo:400:kworker.0 00000100:00100000:0.0:1789778330.552302:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314929792:0@lo:400:kworker.0 00000100:00100000:3.0:1789778330.552323:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778330.552357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778330.552370:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929664 00000100:00100000:3.0:1789778330.552376:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929664 00000100:00100000:0.0:1789778330.552408:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929792 00000100:00100000:0.0:1789778330.552413:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929792 00000100:00100000:3.0:1789778330.552420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789778330.552449:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789778330.552455:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314929792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778330.552491:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314929792:12345-0@lo:400:kworker.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778330.552498:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789778330.552523:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314929792:0@lo:400:kworker.0 00000100:00100000:3.0:1789778330.552574:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314929664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778330.552607:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314929664:12345-0@lo:400:kworker.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778330.552726:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314929536:12345-0@lo:400:kworker.0 Request processed in 1166us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778330.552881:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314929536:0@lo:400:kworker.0 00000100:00080000:1.0:1789778330.552909:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789778330.552913:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778330.564740:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314929664:0@lo:400:kworker.0 00000100:00100000:3.0:1789778330.568306:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789778330.568380:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789778331.059734:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314929920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778331.061286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778331.061376:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314929920 00000100:00100000:3.0:1789778331.061388:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314929920 00000100:00100000:3.0:1789778331.061601:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789778331.061614:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314929920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789778331.061656:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778331.061731:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314929920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778331.061738:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789778331.061908:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314929920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778331.317648:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778331.420898:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778331.420945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778331.420985:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778331.421015:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296076160 00000100:00100000:1.0:1789778331.421033:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296076160 00000100:00100000:1.0:1789778331.421118:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:1.0:1789778331.421128:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296076160:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778331.421214:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2372:x1876718296076160:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778331.421222:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00080000:1.0:1789778331.421312:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778331.421549:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296075904 00000100:00100000:0.0:1789778331.421554:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296075904 00000100:00100000:0.0:1789778331.421603:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:0.0:1789778331.421612:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec0d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:2372:x1876718296075904:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778331.421657:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec0d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:2372:x1876718296075904:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 46us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778331.421664:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 165 00000100:00100000:3.0:1789778331.422711:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296075776 00000100:00100000:3.0:1789778331.422719:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296075776 00000100:00100000:3.0:1789778331.422813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 301 00000100:00100000:3.0:1789778331.422822:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718296075776:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778331.422870:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2373:x1876718296075776:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 50us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778331.422888:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 301 00000100:00080000:2.0:1789778331.423231:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778331.427790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778331.427831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778331.427915:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296076032 00000100:00100000:0.0:1789778331.427924:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296076032 00000100:00100000:0.0:1789778331.427988:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:0.0:1789778331.427998:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718296076032:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778331.428088:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2373:x1876718296076032:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 91us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778331.428095:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00080000:3.0:1789778331.428499:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778331.429620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296076288 00000100:00100000:2.0:1789778331.429631:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296076288 00000100:00100000:2.0:1789778331.429700:0:8093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00100000:2.0:1789778331.429708:0:8093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2373:x1876718296076288:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778331.429765:0:8093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2373:x1876718296076288:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 58us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778331.429772:0:8093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 166 00000100:00080000:3.0:1789778331.429926:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789778332.316655:0:12814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:38:50 (1789778330) 00010000:00010000:2.0:1789778332.338679:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778333.361319:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778334.386879:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778335.169608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778335.169801:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296076544 00000100:00100000:0.0:1789778335.169812:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296076544 00000100:00100000:0.0:1789778335.169915:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00100000:0.0:1789778335.169927:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+18:12354:x1876718296076544:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:0.0:1789778335.170363:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:12354:x1876718296076544:12345-192.168.201.45@tcp:35:umount.0 Request processed in 438us (775us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789778335.170372:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 66 00000100:00080000:3.0:1789778335.171894:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778335.175578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778335.175774:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296076800 00000100:00100000:2.0:1789778335.175784:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296076800 00000100:00100000:2.0:1789778335.175850:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:2.0:1789778335.175861:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+19:12354:x1876718296076800:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:2.0:1789778335.176244:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:12354:x1876718296076800:12345-192.168.201.45@tcp:35:umount.0 Request processed in 384us (676us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789778335.176253:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 67 00000100:00100000:0.0:1789778335.179559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778335.180651:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296077056 00000100:00100000:2.0:1789778335.180665:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296077056 00000100:00100000:2.0:1789778335.180791:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:2.0:1789778335.180803:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e86776850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+20:12354:x1876718296077056:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:2.0:1789778335.182228:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e86776850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:12354:x1876718296077056:12345-192.168.201.45@tcp:35:umount.0 Request processed in 1420us (2671us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789778335.182241:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 68 00000100:00100000:3.0:1789778335.194560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778335.203151:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296077312 00000100:00100000:1.0:1789778335.203169:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296077312 00000100:00100000:1.0:1789778335.203238:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:1.0:1789778335.203249:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+21:12354:x1876718296077312:12345-192.168.201.45@tcp:35:umount.0 00000100:00100000:1.0:1789778335.204790:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:12354:x1876718296077312:12345-192.168.201.45@tcp:35:umount.0 Request processed in 1535us (10234us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789778335.204804:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 69 00000100:00100000:0.0:1789778335.218919:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778335.218958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778335.218979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778335.219049:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296077440 00000100:00100000:2.0:1789778335.219060:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296077440 00000100:00100000:2.0:1789778335.219171:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296077696 00000100:00100000:2.0:1789778335.219174:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296077696 00000100:00100000:2.0:1789778335.219187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296077568 00000100:00100000:2.0:1789778335.219189:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296077568 00000100:00100000:2.0:1789778335.219204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1789778335.219213:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+15:2374:x1876718296077440:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778335.219229:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778335.219252:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81656600/0x5a1e1c1157440d96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a87 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778335.219280:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778335.219341:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+14:2374:x1876718296077440:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 127us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778335.219349:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1789778335.219369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1789778335.219375:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+13:2374:x1876718296077696:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778335.219382:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778335.219404:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95756800/0x5a1e1c1157440f8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b52 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778335.219412:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778335.219432:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+12:2374:x1876718296077696:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 57us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778335.219437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:2.0:1789778335.219449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:2.0:1789778335.219456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+11:2374:x1876718296077568:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778335.219477:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778335.219485:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657e00/0x5a1e1c1157440cfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a4f expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778335.219493:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778335.219511:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718296077568:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 56us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778335.219516:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:0.0:1789778335.225645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778335.225890:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296078080 00000100:00100000:1.0:1789778335.225901:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296078080 00000100:00100000:1.0:1789778335.225976:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00100000:1.0:1789778335.225987:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2371:x1876718296078080:12345-192.168.201.45@tcp:9:umount.0 00000020:00000080:1.0:1789778335.226017:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c11574412d6 00000020:00010000:1.0:1789778335.226025:0:6691:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b3e88afb800: total 0 00000100:00080000:1.0:1789778335.226030:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9b3e88af9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789778335.226113:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789778335.227658:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2371:x1876718296078080:12345-192.168.201.45@tcp:9:umount.0 Request processed in 1666us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778335.227668:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 73 00000100:00080000:3.0:1789778335.227756:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1789778335.232022:0:5835:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b3e88afb800: total 0 00010000:00010000:0.0:1789778335.232141:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b3e88afb800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789778335.232206:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c1157441672 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d27 expref: 4 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778335.232244:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097c71784/0x5a1e1c1157441d10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ef5 expref: 3 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778335.232261:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b3e88afb800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789778335.232286:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778335.232289:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778335.232291:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778335.246758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778335.246945:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296078208 00000100:00100000:0.0:1789778335.246955:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296078208 00000100:00080000:3.0:1789778335.247008:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778335.247040:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:0.0:1789778335.247052:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+5:2371:x1876718296078208:12345-192.168.201.45@tcp:9:umount.0 00000020:00000080:0.0:1789778335.247142:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c115744106e 00000100:00080000:0.0:1789778335.247171:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9b3ebfe37800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789778335.247223:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1789778335.247294:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778335.247511:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+2:2371:x1876718296078208:12345-192.168.201.45@tcp:9:umount.0 Request processed in 460us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778335.247520:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 74 00000100:00100000:2.0:1789778335.263043:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778335.264985:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296079232 00000100:00100000:0.0:1789778335.265000:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296079232 00000100:00100000:2.0:1789778335.265120:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 240 00000100:00100000:2.0:1789778335.265142:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+22:2371:x1876718296079232:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:2.0:1789778335.265186:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440d0a 00000020:00010000:2.0:1789778335.265205:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b3e88cf0000: total 0 00000100:00080000:2.0:1789778335.265211:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9b3d82bc0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789778335.265244:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1789778335.265379:0:5835:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b3e88cf0000: total 0 00010000:00010000:1.0:1789778335.265384:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778335.265433:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b3e88cf0000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789778335.265466:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:1.0:1789778335.265470:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789778335.265478:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320200/0x5a1e1c1157441331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7c4e expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265499:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3e91b87c00) 00010000:00010000:1.0:1789778335.265502:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778335.265506:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82320c00/0x5a1e1c1157440fd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b60 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265554:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:1.0:1789778335.265556:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789778335.265561:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f3000/0x5a1e1c11574416f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d4a expref: 19 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265575:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b3ea4c7a200) 00010000:00010000:1.0:1789778335.265577:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789778335.265581:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ec21f2200/0x5a1e1c11574419cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7e1c expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265611:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b3e922c1d00) 00010000:00010000:1.0:1789778335.265614:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789778335.265618:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f8c00/0x5a1e1c1157441044 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b7c expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265634:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:1.0:1789778335.265636:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778335.265640:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321400/0x5a1e1c1157441bf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ea8 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265652:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778335.265655:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778335.265658:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c1157441553 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7cda expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265670:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a500) 00010000:00010000:1.0:1789778335.265672:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778335.265682:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157440ff0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b67 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265698:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:1.0:1789778335.265700:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778335.265704:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d82321000/0x5a1e1c1157441cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ee0 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265715:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:1.0:1789778335.265717:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778335.265720:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9a00/0x5a1e1c11574416d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d43 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265732:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778335.265745:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789778335.265749:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44cc00/0x5a1e1c1157441633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d12 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265760:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b3e91b87f00) 00010000:00010000:1.0:1789778335.265763:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789778335.265766:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e833f9800/0x5a1e1c115744165d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7d20 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265780:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:1.0:1789778335.265783:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789778335.265786:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3ebf44da00/0x5a1e1c1157441cfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7eee expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778335.265799:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b3e88cf0000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789778335.265815:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778335.265828:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778335.265830:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778335.266928:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bdd103b9-ae1a-4bf0-9cc3-bcece875c39a+7:2371:x1876718296079232:12345-192.168.201.45@tcp:39:umount.0 Request processed in 1791us (3887us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789778335.283132:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 240 00010000:00010000:3.0:1789778335.409583:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778335.665429:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778335.665455:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec15e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314930048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778335.665524:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778335.666666:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930048 00000100:00100000:0.0:1789778335.666677:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930048 00000100:00100000:1.0:1789778335.666905:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314930560:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.666958:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778335.666991:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789778335.666997:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314930176:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667029:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778335.667046:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314930688:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778335.667137:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314930304:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667160:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778335.667176:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778335.667181:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314930432:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778335.667241:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930560 00000100:00100000:1.0:1789778335.667245:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930560 00000100:00100000:1.0:1789778335.667273:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930304 00000100:00100000:1.0:1789778335.667276:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930304 00000100:00100000:1.0:1789778335.667287:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930432 00000100:00100000:1.0:1789778335.667289:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930432 00000100:00100000:1.0:1789778335.667304:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789778335.667311:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667360:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314930560:12345-0@lo:400:kworker.0 Request processed in 49us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778335.667367:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789778335.667402:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314930560:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789778335.667444:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314930304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667473:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314930304:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778335.667479:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789778335.667499:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314930304:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667512:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789778335.667518:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667560:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314930432:12345-0@lo:400:kworker.0 Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778335.667566:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789778335.667585:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314930432:0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667622:0:8205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930688 00000100:00100000:1.0:1789778335.667625:0:8205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930688 00000100:00100000:1.0:1789778335.667651:0:8205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789778335.667657:0:8205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb90f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778335.667687:0:8205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb90f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314930688:12345-0@lo:400:kworker.0 Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778335.667692:0:8205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789778335.667712:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314930688:0@lo:400:kworker.0 00000100:00080000:3.0:1789778335.668366:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778335.668373:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789778335.668375:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789778335.668390:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930176 00000100:00100000:3.0:1789778335.668395:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930176 00000100:00100000:3.0:1789778335.668442:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789778335.668451:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314930176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778335.668500:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3310:x1876718314930176:12345-0@lo:400:kworker.0 Request processed in 50us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778335.668528:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789778335.669134:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314930176:0@lo:400:kworker.0 00000100:00100000:0.0:1789778335.669226:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789778335.669239:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314930048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778335.669275:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778335.669334:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314930048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (3810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778335.669340:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789778335.669418:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec15e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314930048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789778336.177651:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314930816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778336.177742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778336.178495:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930816 00000100:00100000:0.0:1789778336.178505:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930816 00000100:00100000:0.0:1789778336.178572:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789778336.178582:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314930816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789778336.178618:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789778336.178679:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314930816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778336.178687:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789778336.179164:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314930816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789778336.434430:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778336.522582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778336.522638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778336.522839:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296079488 00000100:00100000:1.0:1789778336.522850:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296079488 00000100:00100000:1.0:1789778336.522925:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00100000:1.0:1789778336.522936:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2374:x1876718296079488:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778336.523014:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2374:x1876718296079488:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 80us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778336.523022:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 170 00000100:00080000:2.0:1789778336.523331:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789778336.523439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296079360 00000100:00100000:3.0:1789778336.523444:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296079360 00000100:00100000:3.0:1789778336.523481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 303 00000100:00100000:3.0:1789778336.523490:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718296079360:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778336.523547:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e91e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2374:x1876718296079360:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 58us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778336.523554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 303 00000100:00100000:0.0:1789778336.935842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778336.935887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778336.935989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778336.936150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296079872 00000100:00100000:1.0:1789778336.936165:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296079872 00000100:00100000:1.0:1789778336.936250:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296080000 00000100:00100000:1.0:1789778336.936254:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296080000 00000100:00100000:1.0:1789778336.936279:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1789778336.936291:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+11:2372:x1876718296079872:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778336.936308:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778336.936333:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657200/0x5a1e1c1157440de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ac6 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778336.936364:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778336.936428:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+10:2372:x1876718296079872:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 138us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778336.936436:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:1.0:1789778336.936454:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1789778336.936461:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9563b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+9:2373:x1876718296080000:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778336.936470:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778336.936487:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157440f79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7b4b expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778336.936514:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778336.936535:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9563b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+8:2373:x1876718296080000:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 74us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778336.936541:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:3.0:1789778336.938188:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296079744 00000100:00100000:3.0:1789778336.938202:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296079744 00000100:00100000:3.0:1789778336.938270:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 241 00000100:00100000:3.0:1789778336.938281:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+6:2371:x1876718296079744:12345-192.168.201.45@tcp:39:umount.0 00000020:00000080:3.0:1789778336.938329:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440df1 00000020:00010000:3.0:1789778336.938339:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b3ea0199000: total 0 00000100:00080000:3.0:1789778336.938467:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9b3ea019c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789778336.938802:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1789778336.939234:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14c48d7e-8983-41f6-9a41-ddf92e2ec256+5:2371:x1876718296079744:12345-192.168.201.45@tcp:39:umount.0 Request processed in 952us (3404us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789778336.939244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 241 00000100:00100000:0.0:1789778336.939818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778336.940190:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296080128 00000100:00100000:3.0:1789778336.940199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296080128 00000100:00100000:3.0:1789778336.940251:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:3.0:1789778336.940260:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+8:2372:x1876718296080128:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789778336.940273:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778336.940292:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95757600/0x5a1e1c1157440ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a9c expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778336.940326:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778336.941394:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14cc3ffd-125e-4ebe-b788-5465d0332197+7:2372:x1876718296080128:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1128us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778336.941405:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000020:00010000:2.0:1789778336.945742:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b3ea0199000: total 0 00010000:00010000:2.0:1789778336.945809:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b3ea0199000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789778336.945845:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e922c1900) 00010000:00010000:2.0:1789778336.945864:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778336.945877:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c1157441d1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7efc expref: 4 pid: 8093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778336.945903:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b3ea0199000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789778336.945916:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778336.945918:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778336.945920:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778336.981741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778336.981837:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296080384 00000100:00100000:1.0:1789778336.981848:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296080384 00000100:00100000:1.0:1789778336.981904:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 304 00000100:00100000:1.0:1789778336.981915:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+7:2371:x1876718296080384:12345-192.168.201.45@tcp:251:umount.0 00000020:00000080:1.0:1789778336.981959:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440ce7 00000020:00010000:1.0:1789778336.981966:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b3e88cf5000: total 0 00000100:00080000:1.0:1789778336.981970:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9b3e88cf3000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789778336.982050:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14cc3ffd-125e-4ebe-b788-5465d0332197+3:2371:x1876718296080384:12345-192.168.201.45@tcp:251:umount.0 Request processed in 135us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778336.982088:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 304 00000020:00010000:0.0:1789778336.982189:0:5835:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b3e88cf5000: total 0 00010000:00010000:0.0:1789778336.982193:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778336.982237:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b3e88cf5000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789778336.982272:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157440d9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7a8e expref: 2 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778336.982288:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b3e88cf5000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789778336.982298:0:5835:0:(genops.c:885:class_export_put()) final put ffff9b3e88cf5000/14cc3ffd-125e-4ebe-b788-5465d0332197 00010000:00010000:0.0:1789778336.982315:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778336.982316:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778336.982318:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789778336.982660:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e88cf5000/14cc3ffd-125e-4ebe-b788-5465d0332197 for MGS 00000020:00000080:1.0:1789778336.982699:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3e88cf3000 for MGS 00010000:00010000:2.0:1789778337.457461:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778338.484282:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789778338.611527:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789778338.611536:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789778338.611949:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789778338.611956:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:3.0:1789778339.230560:0:13010:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789778339.253346:0:13010:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789778339.253414:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.253425:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.253451:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.253455:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.258305:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789778339.258341:0:13010:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789778339.258397:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789778339.258401:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789778339.258406:0:13010:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789778339.258442:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9b3eb5812000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789778339.258521:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778339.258537:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.258545:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320000 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778339.258555:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.258564:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778339.258569:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778339.258573:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789778339.258574:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789778339.258576:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789778339.258614:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.258620:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778339.258668:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.258692:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3d82320000/0x5a1e1c1157440d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.258713:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778339.258714:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778339.258715:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778339.258721:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789778339.258744:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314931072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778339.258795:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778339.259184:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314930944:0@lo:39:umount.0 00000100:00100000:3.0:1789778339.259231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778339.259331:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931072 00000100:00100000:0.0:1789778339.259339:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931072 00000100:00100000:0.0:1789778339.259420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789778339.259428:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3312:x1876718314931072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789778339.259446:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778339.259457:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95756400/0x5a1e1c1157440d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440d6c expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.259476:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778339.259530:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:3312:x1876718314931072:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778339.259535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789778339.259561:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314931072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778339.259844:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314930944 00000100:00100000:1.0:1789778339.259848:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314930944 00000100:00100000:1.0:1789778339.259883:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789778339.259897:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876718314930944:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789778339.259929:0:5847:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440af6 00000100:00080000:1.0:1789778339.259935:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9b3eb4d88800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789778339.260047:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1876718314930944:12345-0@lo:39:umount.0 Request processed in 149us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778339.260094:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1789778339.260100:0:5847:0:(genops.c:885:class_export_put()) final put ffff9b3e98798000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789778339.260126:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e98798000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789778339.260178:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3eb4d88800 for lustre-MDT0000 00000100:00080000:3.0:1789778339.260428:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3eb5812000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789778339.260448:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314930944:0@lo:39:umount.0 00010000:00010000:2.0:1789778339.260524:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789778339.260611:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789778339.260615:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789778339.260644:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789778339.262418:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.262431:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.262435:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.262447:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.262494:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789778339.262513:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.262518:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.262521:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.262525:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262795:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778339.262801:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262806:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757400 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778339.262809:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262821:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778339.262826:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778339.262830:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789778339.262832:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789778339.262871:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262896:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778339.262943:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262948:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157440d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d81 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262957:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778339.262959:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262970:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ec21f3c00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778339.262972:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.262976:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778339.262979:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778339.262983:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789778339.262984:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1789778339.263007:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.263012:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778339.263039:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.263099:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778339.263100:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778339.263102:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778339.263212:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314931328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778339.263301:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778339.263383:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789778339.263388:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314931200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778339.263415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778339.263457:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931328 00000100:00100000:0.0:1789778339.263462:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931328 00000100:00100000:0.0:1789778339.263490:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931200 00000100:00100000:0.0:1789778339.263492:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931200 00000100:00100000:0.0:1789778339.263516:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789778339.263522:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+19:3311:x1876718314931328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789778339.263531:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778339.263551:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95756a00/0x5a1e1c1157440ca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440ca1 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.263572:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778339.263608:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+18:3311:x1876718314931328:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778339.263615:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789778339.263642:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789778339.263660:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+17:3311:x1876718314931200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789778339.263680:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778339.263687:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157440d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440d7a expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.263694:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778339.263717:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3311:x1876718314931200:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778339.263730:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789778339.263774:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314931200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778339.263780:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3311:1876718314931328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778339.265376:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789778339.265384:0:13010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3ec21f3c00/0x5a1e1c1157440ca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440ca8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778339.265398:0:13010:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789778339.265416:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.265421:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.265425:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.265429:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.265452:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778339.265456:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.265460:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150e400 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778339.265462:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.265468:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778339.265472:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778339.265475:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789778339.265477:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789778339.265494:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.265560:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778339.265581:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.265586:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778339.265587:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778339.265588:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778339.265627:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314931456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778339.265671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778339.265751:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931456 00000100:00100000:2.0:1789778339.265757:0:12471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931456 00000100:00100000:2.0:1789778339.265793:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789778339.265798:0:12471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+16:3312:x1876718314931456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778339.265805:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778339.265814:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150ea00/0x5a1e1c1157440faa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440fa3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778339.265822:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778339.265894:0:12471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:3312:x1876718314931456:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778339.265898:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789778339.265971:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789778339.265975:0:13010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150e400/0x5a1e1c1157440fa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440faa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778339.265981:0:13010:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789778339.265988:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.265995:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.266001:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.266006:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778339.266056:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789778339.266060:0:13010:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789778339.266082:0:13010:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789778339.266105:0:13010:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789778339.266108:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789778339.266111:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778339.266116:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1789778339.266120:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b3e88cf4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789778339.266124:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b3ebf7c3800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789778339.266130:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b3ea0199000 14c48d7e-8983-41f6-9a41-ddf92e2ec256 192.168.201.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789778339.266133:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b3e88cf0000 bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 192.168.201.45@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1789778339.266137:0:13010:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9b3e880019b8) has exports, disconnecting them 00000020:00080000:1.0:1789778339.266140:0:13010:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b3e88cf4000), last request at 1789778335 00000020:00000080:1.0:1789778339.266146:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440c69 00000100:00080000:1.0:1789778339.266158:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9b3e88cf7800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789778339.266237:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314931456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789778339.266275:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778339.266279:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.266284:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e80031000 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:0.0:1789778339.266286:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.266291:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789778339.266295:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778339.266298:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789778339.266299:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789778339.266300:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789778339.266312:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.266316:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789778339.266335:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.266342:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e80031000/0x5a1e1c1157440a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440a5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.266361:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778339.266363:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778339.266364:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778339.266370:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778339.266378:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314931584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778339.266396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778339.266418:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931584 00000100:00100000:0.0:1789778339.266420:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931584 00000100:00100000:0.0:1789778339.266439:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789778339.266443:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+15:3312:x1876718314931584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789778339.266450:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778339.266456:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150e000/0x5a1e1c1157440a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440a55 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778339.266464:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778339.266480:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:3312:x1876718314931584:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778339.266484:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789778339.266781:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3312:1876718314931584:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789778339.266858:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3e88cf4000): rc 0 00000020:00000080:1.0:1789778339.266860:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3e88cf4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789778339.266873:0:13010:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b3ebf7c3800), last request at 1789778335 00000020:00000080:1.0:1789778339.266876:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440b90 00000100:00080000:1.0:1789778339.266880:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7c2000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789778339.266886:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3ebf7c3800): rc 0 00000020:00000080:1.0:1789778339.266887:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3ebf7c3800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789778339.266896:0:13010:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf4303ca3ae0 00000100:00080000:1.0:1789778339.266920:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789778339.266923:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789778339.266931:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789778339.266980:0:13010:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789778339.266991:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7cf000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789778339.267000:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789778339.267002:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789778339.267015:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789778339.267101:0:13010:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789778339.267109:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9b3d82bc1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789778339.267132:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b3e880019b8) has no exports 00000020:00000080:3.0:1789778339.267381:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e88cf4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789778339.267432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf7c3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789778339.267460:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3e88cf7800 for lustre-MDT0000 00000020:00000080:3.0:1789778339.267463:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ebf7c2000 for lustre-MDT0000 00000100:00100000:3.0:1789778339.267483:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314931712:0@lo:9:umount.0 00000100:00100000:3.0:1789778339.267582:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778339.267609:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314931840:0@lo:9:umount.0 00000100:00100000:3.0:1789778339.267658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778339.267706:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931712 00000100:00100000:3.0:1789778339.267710:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931712 00000100:00100000:3.0:1789778339.267747:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931840 00000100:00100000:3.0:1789778339.267749:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931840 00000100:00100000:3.0:1789778339.267761:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789778339.267776:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec15e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876718314931712:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789778339.267799:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440be4 00000100:00080000:3.0:1789778339.267803:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7de000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789778339.267824:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789778339.268232:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec15e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3309:x1876718314931712:12345-0@lo:9:umount.0 Request processed in 464us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778339.268247:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789778339.268258:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789778339.268271:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876718314931840:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789778339.268280:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440cd2 00000100:00080000:3.0:1789778339.268284:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b3e88cf3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789778339.268295:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789778339.268439:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3309:x1876718314931840:12345-0@lo:9:umount.0 Request processed in 176us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778339.268443:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789778339.268488:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7cf000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789778339.268495:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789778339.268513:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789778339.268516:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314931712:0@lo:9:umount.0 00000100:00080000:3.0:1789778339.268524:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3d82bc1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789778339.268526:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789778339.268527:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789778339.268529:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314931840:0@lo:9:umount.0 00010000:00010000:0.0:1789778339.268812:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789778339.269140:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778339.269144:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789778339.269169:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789778339.273708:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b3e880019b8) has no exports 00000020:00000080:1.0:1789778339.305420:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440ab0 00000020:00000080:1.0:1789778339.305434:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3ec15a7800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789778339.305478:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789778339.305543:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789778339.305551:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789778339.305555:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9b3eb7008000) has no exports 00000020:00000080:2.0:1789778339.305805:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440aa9 00000020:00000080:2.0:1789778339.305810:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb4d8c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789778339.305829:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec15a7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789778339.305885:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb4d8c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789778339.305977:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789778339.305983:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789778339.305985:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb4d8b800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789778339.305987:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb4d8b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789778339.305994:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1789778339.509949:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789778339.795830:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000001:00080000:3.0:1789778339.796889:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1789778339.796962:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000001:00080000:3.0:1789778339.796970:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1789778339.796978:0:5867:0:(genops.c:885:class_export_put()) final put ffff9b3e88cf0000/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:0.0:1789778339.797045:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e88cf0000/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a for lustre-MDT0000 00000020:00000080:0.0:1789778339.797138:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3d82bc0000 for lustre-MDT0000 00000001:00100000:0.0:1789778339.799368:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14c48d7e-8983-41f6-9a41-ddf92e2ec256 00000001:00080000:0.0:1789778339.799381:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1789778339.799384:0:5867:0:(genops.c:885:class_export_put()) final put ffff9b3ea0199000/14c48d7e-8983-41f6-9a41-ddf92e2ec256 00000020:00000080:1.0:1789778339.799443:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ea0199000/14c48d7e-8983-41f6-9a41-ddf92e2ec256 for lustre-MDT0000 00000020:00000080:1.0:1789778339.799588:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ea019c000 for lustre-MDT0000 00000001:00100000:0.0:1789778339.802476:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:0.0:1789778339.802484:0:7641:0:(genops.c:885:class_export_put()) final put ffff9b3e88afb800/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000001:00100000:0.0:1789778339.802628:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789778339.802632:0:7641:0:(genops.c:885:class_export_put()) final put ffff9b3e88cf6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789778339.802691:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e88afb800/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a for lustre-OST0001 00000020:00000080:1.0:1789778339.802729:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e88cf6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789778339.802744:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3e88af9000 for lustre-OST0001 00000020:00000080:1.0:1789778339.802748:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3e88cf3800 for lustre-OST0001 00000001:00100000:3.0:1789778340.348554:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000020:00000080:3.0:1789778340.348565:0:6716:0:(genops.c:885:class_export_put()) final put ffff9b3ebfe32000/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a 00000001:00100000:3.0:1789778340.348593:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789778340.348595:0:6716:0:(genops.c:885:class_export_put()) final put ffff9b3ebf7df800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789778340.348835:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebfe32000/bdd103b9-ae1a-4bf0-9cc3-bcece875c39a for lustre-OST0000 00000020:00000080:2.0:1789778340.348881:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf7df800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789778340.348897:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ebfe37800 for lustre-OST0000 00000020:00000080:2.0:1789778340.348901:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ebf7de000 for lustre-OST0000 00010000:00010000:2.0:1789778340.529724:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778340.785539:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314931968:0@lo:400:kworker.0 00000100:00100000:1.0:1789778340.785618:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778340.788881:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314931968 00000100:00100000:0.0:1789778340.788896:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314931968 00000100:00100000:0.0:1789778340.788971:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789778340.788982:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:3310:x1876718314931968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778340.789305:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314932096:0@lo:400:kworker.0 00000100:00100000:3.0:1789778340.789347:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778340.789422:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314932096 00000100:00100000:3.0:1789778340.789427:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314932096 00000100:00100000:3.0:1789778340.789464:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789778340.789469:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1876718314932096:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789778340.789475:0:5846:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789778340.789508:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1876718314932096:12345-0@lo:400:kworker.0 Request processed in 37us (160us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789778340.789515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1789778340.789564:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789778340.789569:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7dd000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789778340.789573:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789778340.803508:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789778340.804366:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e9866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5+14:3310:x1876718314931968:12345-0@lo:400:kworker.0 Request processed in 15380us (18742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778340.804390:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789778340.804893:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314932224:0@lo:400:kworker.0 00000100:00100000:2.0:1789778340.804967:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778340.805650:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314932224 00000100:00100000:0.0:1789778340.805660:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314932224 00000100:00100000:0.0:1789778340.805721:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789778340.805729:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1876718314932224:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789778340.805737:0:5847:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789778340.805783:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1876718314932224:12345-0@lo:400:kworker.0 Request processed in 53us (815us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789778340.805790:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1789778340.814622:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7dd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789778340.814635:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 189 00000100:00080000:3.0:1789778340.814646:0:3311:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3ebf7dd000 using connection 192.168.201.145@tcp/0@lo 00000100:00080000:2.0:1789778340.814868:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789778340.814873:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1643000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789778340.814877:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789778340.814880:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1643000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789778340.814883:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 209 00000100:00080000:2.0:1789778340.814888:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b3ec1643000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1789778340.814919:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3eb94b0380 x1876718314932352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789778340.814952:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314932224:0@lo:400:kworker.0 00000100:00100000:0.0:1789778340.815042:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314932352:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789778340.815127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778340.815219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314932352 00000100:00100000:2.0:1789778340.815225:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314932352 00000100:00100000:2.0:1789778340.815266:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789778340.815273:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876718314932352:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789778340.815290:0:5846:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789778340.816253:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3310:1876718314931968:0@lo:400:kworker.0 00000100:00100000:3.0:1789778340.816871:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ebfbef480 x1876718314932480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789778340.816922:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314932096:0@lo:400:kworker.0 00000100:00100000:0.0:1789778340.816958:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876718314932480:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789778340.817025:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778340.817130:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314932480 00000100:00100000:3.0:1789778340.817137:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314932480 00000100:00100000:3.0:1789778340.817175:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789778340.817181:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876718314932480:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789778340.817195:0:5847:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789778340.817242:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876718314932480:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 59us (216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789778340.817248:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1789778340.817275:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7dd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789778340.817280:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789778340.817283:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876718314932480:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789778340.833252:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876718314932352:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 17967us (18114us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789778340.833267:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789778340.833326:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1643000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789778340.833331:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789778340.833335:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314932352:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:2.0:1789778341.361936:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3ebf9461e0 - data ffff9b3e9f7de6c0/ffff9b3ebf9ed800 00000020:01000000:2.0:1789778341.362534:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3e922de420 - data ffff9b3e9f42d510/ffff9b3eb6407800 00000001:00000004:2.0:1789778341.384353:0:13010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1789778341.509426:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789778341.509435:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789778341.509456:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789778341.509459:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789778341.512096:0:6738:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789778341.512103:0:6738:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789778341.512115:0:6738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789778341.513803:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789778341.513811:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1789778341.513831:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789778341.513833:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789778341.516660:0:7917:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789778341.516668:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789778341.516683:0:7917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:0.0:1789778341.559304:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789778341.602381:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a78 00000020:00000080:0.0:1789778341.602396:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb9b3e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789778341.604705:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb9b3e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789778341.607376:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a8d 00000020:00000080:1.0:1789778341.607391:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb9b3b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789778341.607456:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789778341.607465:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778341.607474:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789778341.607598:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9b3e88004d28) has no exports 00000004:01000000:1.0:1789778341.607789:0:13010:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789778341.607799:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440ccb 00000020:00000080:1.0:1789778341.607816:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3e88cf2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789778341.608025:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb9b3b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789778341.608399:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789778341.608405:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778341.608413:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789778341.608415:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9b3e91fe4d28) has no exports 00000020:00000080:1.0:1789778341.608423:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440cc4 00000020:00000080:1.0:1789778341.608427:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3d82bc6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789778341.608451:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e88cf2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1789778341.609097:0:13010:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789778341.609109:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789778341.609113:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789778341.609119:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789778341.609121:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789778341.609466:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3d82bc6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789778341.609638:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789778341.609648:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789778341.609656:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440bd6 00000020:00000080:1.0:1789778341.609662:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb7dec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789778341.609680:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3d82bc1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789778341.609685:0:1370:0:(genops.c:885:class_export_put()) final put ffff9b3ec1647800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789778341.609687:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec1647800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789778341.609692:0:1370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789778341.609825:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789778341.609829:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778341.609834:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789778341.609837:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9b3eb97719b8) has no exports 00000020:00000080:1.0:1789778341.609841:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440bcf 00000020:00000080:1.0:1789778341.609845:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3ebf7cb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789778341.609863:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb7dec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1789778341.610509:0:13010:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789778341.610515:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789778341.610519:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789778341.610523:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789778341.610525:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789778341.610624:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf7cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789778341.610711:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789778341.610719:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789778341.610748:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789778341.610752:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789778341.610756:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb5811000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789778341.610770:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb5811000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789778341.610778:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789778341.610913:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a94 00000020:00000080:1.0:1789778341.610920:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb9b3f000/lustre-MDD0000_UUID 00000020:00000080:2.0:1789778341.610940:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ebf7cf000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789778341.610945:0:1370:0:(genops.c:885:class_export_put()) final put ffff9b3ebf7cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789778341.610948:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf7cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789778341.610953:0:1370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789778341.611268:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789778341.611283:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778341.611288:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789778341.611291:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9b3e88000000) has no exports 00000020:00000080:1.0:1789778341.611310:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789778341.611314:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789778341.611319:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a9b 00000020:00000080:1.0:1789778341.611323:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb9b3b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789778341.611398:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb9b3f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789778341.611403:0:1370:0:(genops.c:885:class_export_put()) final put ffff9b3eb9b3d800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789778341.611405:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb9b3d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789778341.611411:0:1370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1789778341.611685:0:13010:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3eabbad800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789778341.611689:0:13010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3eabbad800 3 00000020:01000004:1.0:1789778341.611693:0:13010:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b3eabbad800 from lustre-MDT0000 00000020:00000080:1.0:1789778341.611713:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789778341.611717:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789778341.611720:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb9b3a000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789778341.611722:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb9b3a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789778341.611729:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789778341.611756:0:13010:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789778341.611760:0:13010:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789778341.611764:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789778341.611768:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778341.611770:0:13010:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789778341.611778:0:13010:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9b3e84ef1800 a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789778341.611783:0:13010:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9b3e91fe19b8) has exports, disconnecting them 00000020:00080000:1.0:1789778341.611787:0:13010:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b3e84ef1800), last request at 1789778119 00000020:00000080:1.0:1789778341.611801:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a39 00000020:00010000:1.0:1789778341.611804:0:13010:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b3e84ef1800: total 1 00000100:00080000:1.0:1789778341.611807:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9b3e84ef7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789778341.611820:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3e84ef1800): rc 0 00000020:00080000:1.0:1789778341.611830:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9b3e91fe19b8) has no exports 00000100:00100000:0.0:1789778341.611942:0:5840:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b3e90ef9e00:5840] 1 exiting: rc = 0 00000020:00000080:2.0:1789778341.612049:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb9b3b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1789778341.612061:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b3e84ef1800: total 0 00010000:00010000:2.0:1789778341.613596:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b3e84ef1800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789778341.613626:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95756000/0x5a1e1c1157440d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440d5e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613643:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150fa00/0x5a1e1c1157440d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440d88 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613656:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ec21f2600/0x5a1e1c1157440b43 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440b3c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613692:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150e200/0x5a1e1c1157440f9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440f95 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613704:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657600/0x5a1e1c1157440d3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440d34 expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613714:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95756200/0x5a1e1c1157440d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440d42 expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613723:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e833f9c00/0x5a1e1c1157440f87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440f80 expref: 3 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613736:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81657a00/0x5a1e1c1157440d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5a1e1c1157440d50 expref: 2 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778341.613746:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b3e84ef1800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789778341.613758:0:5834:0:(genops.c:885:class_export_put()) final put ffff9b3e84ef1800/a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5 00010000:00010000:2.0:1789778341.613818:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778341.613820:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778341.613823:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789778341.613963:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e84ef1800/a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5 for MGS 00000100:00100000:3.0:1789778341.614114:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b3e876d1200:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1789778341.614132:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b3e88ccc800:5841] 2 exiting: rc = 0 00000100:00100000:2.0:1789778341.614433:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614444:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614452:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614457:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614463:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614469:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614475:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614545:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614550:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614560:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614564:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614568:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614572:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614576:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614579:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614583:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614586:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614590:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614596:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614600:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614604:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614608:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614611:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614615:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614619:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614623:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614626:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614630:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614634:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614637:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614641:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614646:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614651:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614656:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614662:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614666:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614671:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614676:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614681:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614687:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614692:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614698:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614703:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614707:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614716:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614719:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614723:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614726:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614730:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614733:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614737:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614740:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614743:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614746:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614750:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614753:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614757:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614760:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614763:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614766:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614770:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614773:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614776:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.614779:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789778341.615042:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3e84ef7800 for MGS 20000000:01000000:2.0:1789778341.615380:0:13010:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789778341.615383:0:13010:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789778341.617592:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3e91b64b40 - data ffff9b3e9f483798/ffff9b3ec17ce000 00000020:01000000:1.0:1789778341.617719:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3eaf4e89c0 - data ffff9b3ea6749870/ffff9b3ea00d5c00 00000020:00000080:1.0:1789778341.618231:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a1d 00000020:00000080:1.0:1789778341.618239:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eabba8800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789778341.618255:0:13010:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3eabbad800 from MGS, refs=2 00000020:01000004:1.0:1789778341.618259:0:13010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3eabbad800 2 00000020:01000004:1.0:1789778341.618263:0:13010:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b3eabbad800 from MGS 00000020:00000080:1.0:1789778341.618412:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789778341.618420:0:13010:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789778341.618423:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3e84ef6800/MGS 00000020:00000080:1.0:1789778341.618426:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e84ef6800/MGS for MGS 00000020:01000000:1.0:1789778341.618435:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789778341.618510:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789778341.618515:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778341.618521:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789778341.618531:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b3eb5816800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789778341.618542:0:13010:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9b3eb9773370) has exports, disconnecting them 00000020:00080000:1.0:1789778341.618555:0:13010:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b3eb5816800), last request at 1789778120 00000020:00000080:1.0:1789778341.618559:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440ae8 00000020:00080000:1.0:1789778341.618571:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3eb5816800): rc 0 00000020:00000080:1.0:1789778341.618576:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eb5816800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789778341.619395:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eabba8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789778341.619407:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb5816800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789778341.620121:0:13010:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789778341.620128:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789778341.620133:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789778341.620141:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789778341.620508:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789778341.620517:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789778341.620524:0:13010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3eabbad800 1 00000020:00000080:0.0:1789778341.620530:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a0f 00000020:00000080:0.0:1789778341.620537:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3e84ef0000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789778341.620543:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789778341.620548:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789778341.620552:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789778341.620557:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9b3e85d04d28) has no exports 00000020:00000080:2.0:1789778341.622016:0:1370:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3eb5812000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789778341.622029:0:1370:0:(genops.c:885:class_export_put()) final put ffff9b3eb9b3e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789778341.622032:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb9b3e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789778341.622040:0:1370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789778341.622115:0:1370:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e84ef0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789778341.671628:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789778341.671647:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789778341.671653:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3eabbaf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789778341.671657:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eabbaf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789778341.671671:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789778341.671840:0:13010:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b3eabbab000 00000020:01000000:0.0:1789778341.671868:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789778341.671873:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789778341.671879:0:13010:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789778341.671883:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9b3e88003370) has no exports 00000100:00100000:0.0:1789778341.672006:0:8093:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b3eb5e80a00:8093] 3 exiting: rc = 0 00000100:00100000:2.0:1789778341.673637:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b3e88021600:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1789778341.674534:0:5847:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b3e9867ba00:5847] 2 exiting: rc = 0 00000100:00100000:3.0:1789778341.674618:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b3e87dc9e00:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1789778341.674879:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.674888:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.674912:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.674918:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.674958:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.674966:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.674982:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.674991:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675000:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675009:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675017:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675025:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675034:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675042:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675049:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675057:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675092:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675100:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675107:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675116:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675121:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675127:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675133:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675141:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675148:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675155:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675162:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675167:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675174:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675183:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675188:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675193:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675199:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675205:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675212:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675232:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675238:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675246:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675254:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675262:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675273:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675280:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675291:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675302:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675309:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675320:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675375:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675382:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675388:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675393:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675400:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675408:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675417:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675422:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675429:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675435:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675441:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675447:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675454:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675459:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675465:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675471:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675541:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.675552:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.682322:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b3e8800fa00:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1789778341.683437:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b3e87dc8800:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1789778341.683700:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683710:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683716:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683726:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683733:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683738:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683745:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683751:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683757:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.683762:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684004:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684433:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684445:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684455:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684462:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684469:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684475:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684490:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684496:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684501:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684507:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684514:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684519:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684525:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684532:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684538:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684548:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684556:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684564:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684572:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684580:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684588:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684597:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684604:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684612:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684618:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684627:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684635:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684643:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684650:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684658:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684666:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684674:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684681:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684689:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684710:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684720:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684726:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684736:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684743:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684749:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684754:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684758:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684774:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684783:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684788:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684793:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684802:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684809:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684814:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684985:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.684996:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.685004:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.685013:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778341.685933:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b3e88cf9200:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1789778341.685937:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b3e8800f400:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1789778341.686052:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686097:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686107:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686116:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686126:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686135:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686145:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686153:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686163:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686172:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686182:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686209:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686222:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686231:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686243:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686253:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686280:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686286:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686292:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686299:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686305:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686311:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686317:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686343:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686351:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686357:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686368:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686375:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686381:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686391:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686398:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686408:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686414:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686420:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686426:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686448:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686455:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686461:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686467:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686473:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686494:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686501:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686508:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686519:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686525:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686536:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686542:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686661:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686669:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686674:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686680:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686697:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686707:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686714:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686720:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686731:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686738:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686748:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686755:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686783:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686791:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686797:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686808:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.686814:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.709050:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b3e987c4c00:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1789778341.709265:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b3e85f2ea00:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1789778341.709404:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709413:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709419:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709425:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709430:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709436:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709441:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709447:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709453:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709459:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709464:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709470:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709486:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709492:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709498:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709503:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709508:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709514:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709519:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709525:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709531:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709536:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709554:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709560:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709565:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709571:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709577:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709582:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709590:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709597:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709605:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709612:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709619:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709626:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709634:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709641:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709648:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709655:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709663:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709669:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709676:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709682:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709689:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709696:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709703:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709711:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709718:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709724:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709731:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709737:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709744:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709750:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709757:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709764:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709774:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709786:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709795:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709808:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709813:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709831:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709843:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709850:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709856:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.709861:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.710395:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b3e987c5a00:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1789778341.710591:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b3e987c5800:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1789778341.711240:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.711250:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712369:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712388:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712399:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712410:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712418:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712423:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712433:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712445:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712458:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.712468:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713770:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713786:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713791:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713797:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713802:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713807:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713813:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713819:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713824:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713830:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713835:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713840:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713846:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713851:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713858:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713863:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713885:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713890:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713896:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713902:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713907:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713913:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713918:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713923:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713929:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713935:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713941:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713947:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713952:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713957:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713962:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713967:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713972:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713988:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713993:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.713998:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714003:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714008:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714014:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714019:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714025:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714030:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714035:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714041:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714046:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714051:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714057:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.714063:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.715990:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.715996:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.716002:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789778341.716024:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778341.720609:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b3e987c4800:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1789778341.724917:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b3e987c5600:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1789778341.725719:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725726:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725731:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725746:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725751:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725758:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725763:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725768:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725774:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725782:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725788:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725793:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725798:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725802:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725808:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725812:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725817:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725823:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725827:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725832:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725836:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725841:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725847:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725851:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725856:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725861:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725866:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725871:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725875:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725880:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725885:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725889:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725893:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725898:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725902:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725908:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725913:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725918:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725930:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725935:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725941:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725946:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725951:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725956:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725961:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725966:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725971:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725985:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725991:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.725996:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726001:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726007:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726012:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726020:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726025:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726030:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726035:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726040:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726045:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726051:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726055:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726061:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726082:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.726099:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.731320:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b3e987b4600:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1789778341.731502:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b3e88016a00:5858] 0 exiting: rc = 1 00000100:00100000:3.0:1789778341.733686:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b3e87dca800:5860] 2 exiting: rc = 0 00000100:00100000:3.0:1789778341.733776:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733799:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733807:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733814:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733821:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733826:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733832:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733852:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733857:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733862:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733868:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733874:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733879:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733885:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733891:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733897:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733903:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733909:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733918:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733923:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733928:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733933:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733938:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733944:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733950:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.733968:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734002:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734008:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734014:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734020:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734027:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734032:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734038:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734043:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734050:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734058:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734082:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734089:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734094:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734100:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734105:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734111:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734124:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734129:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734135:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734140:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734146:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734151:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734156:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734175:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734182:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734189:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734195:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734200:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734205:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734211:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734217:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734234:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734241:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734246:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734251:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734256:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734262:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778341.734268:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789778341.762439:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789778341.762452:0:13010:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789778341.762458:0:13010:0:(genops.c:885:class_export_put()) final put ffff9b3ea01d9000/MDS_uuid 00000020:00000080:3.0:1789778341.762462:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ea01d9000/MDS_uuid for MDS 00000020:01000000:3.0:1789778341.762469:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789778341.762615:0:13010:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789778342.578297:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778343.603262:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778344.625259:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789778345.152362:0:13164:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789778345.180725:0:13164:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789778345.180772:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778345.180787:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778345.180811:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778345.180818:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778345.180842:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789778345.180848:0:13164:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789778345.180877:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789778345.180881:0:13164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789778345.180887:0:13164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789778345.180892:0:13164:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7dd000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789778345.180896:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789778345.180898:0:13164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789778345.180900:0:13164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789778345.181796:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778345.181812:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778345.181821:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320e00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778345.181825:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778345.181834:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778345.181841:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778345.181846:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789778345.181849:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789778345.181851:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789778345.182225:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778345.182236:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778345.191601:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778345.191618:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778345.191656:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778345.191664:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3d82320e00/0x5a1e1c1157440d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5a1e1c1157440d57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778345.191679:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778345.191681:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778345.191683:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778345.191972:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314932608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778345.192047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778345.192662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314932608 00000100:00100000:2.0:1789778345.192671:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314932608 00000100:00100000:2.0:1789778345.192721:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789778345.192741:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95639850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1876718314932608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789778345.192747:0:5833:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789778345 with bad export cookie 6493658573518932537 00000100:00100000:2.0:1789778345.204353:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95639850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1876718314932608:12345-0@lo:103:ldlm_bl.0 Request processed in 11604us (12298us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789778345.204368:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789778345.205520:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789778345.205527:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9b3e88f48800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789778345.205531:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.145@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789778345.212828:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.145@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789778345.212835:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789778345.212844:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3eb94b2a00 x1876718314932608/t0(0) o103->MGC192.168.201.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789778361 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789778345.212858:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789778345.212861:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789778345.212863:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789778345.212867:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9b3e88f48800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789778345.212871:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 174 00000100:00080000:0.0:1789778345.212879:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.201.145@tcp: import ffff9b3e88f48800 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1789778345.212927:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ec17aaa00 x1876718314932736/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789778345.212964:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3313:1876718314932608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778345.213400:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3309:1876718314932736:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1789778345.213452:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876718314932736 offset 0 length 520: 4 00010000:00010000:3.0:1789778345.214033:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778345.214047:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778345.214667:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789778345.214681:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778345.214691:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778345.214717:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778345.214724:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778345.214745:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789778345.214751:0:13164:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789778345.214780:0:13164:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789778345.214784:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789778345.214791:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789778345.214796:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789778345.214800:0:13164:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b3eb9774d28) has no exports 00000020:00080000:0.0:1789778345.214827:0:13164:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b3eb9774d28) has no exports 00010000:00010000:1.0:1789778345.215009:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778345.215015:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215024:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320a00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778345.215028:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215037:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778345.215043:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778345.215050:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789778345.215052:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789778345.215054:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789778345.215090:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3e88f48800 00010000:00010000:1.0:1789778345.215094:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215101:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3d82320a00/0x5a1e1c1157440d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440d65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215114:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778345.215118:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215139:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757000 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778345.215143:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215150:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778345.215156:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778345.215161:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789778345.215163:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789778345.215165:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789778345.215176:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3e88f48800 00010000:00010000:1.0:1789778345.215179:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215202:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757000/0x5a1e1c1157440f95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440f9c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778345.215211:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778345.215212:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778345.215214:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778345.215300:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789778345.220806:0:13164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3ebf9463c0 - data ffff9b3e821d3af8/ffff9b3ebf9ee400 00000020:01000000:0.0:1789778345.220976:0:13164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3e85c48cc0 - data ffff9b3d81515000/ffff9b3ebf8f6800 00100000:10000000:0.0:1789778345.246549:0:13164:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789778345.282841:0:13164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440b5f 00000020:00000080:2.0:1789778345.282849:0:13164:0:(genops.c:885:class_export_put()) final put ffff9b3eb7014800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789778345.282866:0:13164:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3ec0d89800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789778345.282869:0:13164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ec0d89800 2 00000020:01000004:2.0:1789778345.282872:0:13164:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b3ec0d89800 from lustre-OST0000 00000020:00000080:2.0:1789778345.282893:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789778345.282902:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789778345.282905:0:13164:0:(genops.c:885:class_export_put()) final put ffff9b3eb5814800/lustre-OST0000_UUID 00000020:00000080:2.0:1789778345.282908:0:13164:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb5814800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789778345.282924:0:13164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789778345.282961:0:13164:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789778345.282964:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789778345.282968:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789778345.282972:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789778345.282979:0:13164:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b3ebf7c7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789778345.282984:0:13164:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9b3ebf7d0000) has exports, disconnecting them 00000020:00080000:2.0:1789778345.282990:0:13164:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b3ebf7c7000), last request at 1789778134 00000020:00000080:2.0:1789778345.282993:0:13164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440b89 00000020:00080000:2.0:1789778345.283001:0:13164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3ebf7c7000): rc 0 00000020:00000080:2.0:1789778345.283005:0:13164:0:(genops.c:885:class_export_put()) final put ffff9b3ebf7c7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789778345.283834:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3eb7014800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789778345.283848:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf7c7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789778345.286595:0:13164:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789778345.286603:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789778345.286607:0:13164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789778345.286615:0:13164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789778345.286796:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789778345.286806:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789778345.286813:0:13164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ec0d89800 1 00000020:00000080:0.0:1789778345.286822:0:13164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440b19 00000020:00000080:0.0:1789778345.286831:0:13164:0:(genops.c:885:class_export_put()) final put ffff9b3ec13f7000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789778345.286837:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789778345.286841:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789778345.286845:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789778345.286860:0:13164:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9b3e85d00000) has no exports 00000020:00000080:1.0:1789778345.286939:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ebf7dd000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789778345.286947:0:36:0:(genops.c:885:class_export_put()) final put ffff9b3ec13f5000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789778345.286950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec13f5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789778345.286962:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789778345.287026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec13f7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789778345.317999:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789778345.318014:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789778345.318020:0:13164:0:(genops.c:885:class_export_put()) final put ffff9b3ec0d8b000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789778345.318024:0:13164:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec0d8b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789778345.318033:0:13164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789778345.318182:0:13164:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b3ec0d8c800 00000020:02000400:0.0:1789778345.318234:0:13164:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789778345.649394:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789778345.924597:0:1370:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789778345.924608:0:1370:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789778345.925275:0:1370:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1643000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789778345.925285:0:1370:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 395 00000100:00080000:3.0:1789778345.925291:0:1370:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789778345.925297:0:1370:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b3ec1643000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1789778345.925392:0:1370:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ebfbef480 x1876718314932864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789778345.925472:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314932864:0@lo:38:kworker.0 00000400:00000100:1.0:1789778345.925530:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876718314932864 offset 0 length 520: 4 00010000:00010000:3.0:1789778346.674350:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778347.707098:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778348.731737:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789778349.568877:0:13314:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789778349.582202:0:13314:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789778349.582277:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778349.582291:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778349.582299:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778349.582306:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778349.582325:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789778349.582331:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789778349.582350:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789778349.582361:0:13314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3ebfbef480 x1876718314932864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789778360 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778349.582383:0:13314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789778349.582390:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789778349.582396:0:13314:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1643000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789778349.582401:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789778349.582419:0:13314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3ebfbef480 x1876718314932864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789778360 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778349.582426:0:13314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789778349.582429:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1789778349.582647:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314932864:0@lo:38:kworker.0 00010000:00010000:1.0:1789778349.584235:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778349.584245:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.584256:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320400 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778349.584260:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.584271:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778349.584278:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778349.584283:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789778349.584286:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789778349.584289:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789778349.584304:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3e88f48800 00010000:00010000:1.0:1789778349.584308:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.584314:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3d82320400/0x5a1e1c1157440d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.584340:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778349.584342:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778349.584344:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778349.588984:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589001:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589009:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589016:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589033:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789778349.589040:0:13314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589046:0:13314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589052:0:13314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589059:0:13314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589085:0:13314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789778349.589100:0:13314:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789778349.589118:0:13314:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789778349.589122:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1789778349.589140:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778349.589147:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589154:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757c00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778349.589158:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589167:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778349.589174:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778349.589179:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789778349.589182:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789778349.589184:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789778349.589199:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3e88f48800 00010000:00010000:1.0:1789778349.589202:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589209:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757c00/0x5a1e1c1157440d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440d49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589219:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778349.589222:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589236:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778349.589239:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589245:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778349.589251:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778349.589256:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789778349.589258:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789778349.589260:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789778349.589264:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3e88f48800 00010000:00010000:1.0:1789778349.589267:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589273:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e8150f800/0x5a1e1c1157440f80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440f87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778349.589285:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778349.589286:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778349.589288:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789778349.589295:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789778349.589301:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789778349.589304:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b3eb9770000) has no exports 00000020:00080000:1.0:1789778349.589325:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b3eb9770000) has no exports 00000020:01000000:1.0:1789778349.590969:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3e95683ea0 - data ffff9b3d81513510/ffff9b3ec0cbb000 00000020:01000000:1.0:1789778349.591139:0:13314:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b3ebf42fa20 - data ffff9b3ea67bf360/ffff9b3ec1704800 00010000:00010000:0.0:1789778349.601114:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789778349.632371:0:13314:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789778349.651563:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440c38 00000020:00000080:0.0:1789778349.651574:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3ebf39d000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789778349.651589:0:13314:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3ebf7c9000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789778349.651593:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ebf7c9000 2 00000020:01000004:0.0:1789778349.651596:0:13314:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b3ebf7c9000 from lustre-OST0001 00000020:00000080:0.0:1789778349.651620:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789778349.651630:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789778349.651633:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3ebf39b800/lustre-OST0001_UUID 00000020:00000080:0.0:1789778349.651636:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf39b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789778349.651642:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789778349.651760:0:13314:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5->MGS 00010000:00010000:0.0:1789778349.651775:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757a00/0x5a1e1c1157440b3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440b43 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789778349.651787:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757a00/0x5a1e1c1157440b3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440b43 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778349.651793:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789778349.651796:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789778349.651798:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789778349.651811:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3e88f48800 00010000:00010000:0.0:1789778349.651815:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757a00/0x5a1e1c1157440b3c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440b43 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778349.651828:0:13314:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5a1e1c1157440d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789778349.651862:0:13314:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5a1e1c1157440d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778349.651868:0:13314:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789778349.651870:0:13314:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789778349.651872:0:13314:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789778349.651883:0:13314:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3e88f48800 00010000:00010000:0.0:1789778349.651885:0:13314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e81656c00/0x5a1e1c1157440d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5a1e1c1157440d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789778349.651904:0:13314:0:(import.c:65:import_set_state_nolock()) ffff9b3e88f48800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789778349.651907:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789778349.651909:0:13314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789778349.651911:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789778349.651915:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789778349.651926:0:13314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3ec17aaa00 x1876718314932736/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789778355 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789778349.651939:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789778349.651942:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:3.0:1789778349.652061:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf39d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1789778349.653254:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5:3309:1876718314932736:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:0.0:1789778349.655086:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789778349.655101:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440a2b 00000020:00000080:0.0:1789778349.655109:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3e88d7f000/a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5 00000020:01000000:0.0:1789778349.655126:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.145@tcp (flags='') 00000020:00000080:3.0:1789778349.655212:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e88d7f000/a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5 for MGC192.168.201.145@tcp 00000020:00000080:0.0:1789778349.655286:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789778349.655294:0:13314:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.145@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789778349.655298:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9b3e85d019b8) has no exports 10000000:01000000:2.0:1789778349.655352:0:5843:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789778349.655656:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.145@tcp: client import never connected 00000100:00080000:0.0:1789778349.655660:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789778349.655663:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789778349.655666:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789778349.655681:0:13314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789778349.655726:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789778349.655733:0:13314:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.145@tcp (uuid a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5) 00000020:01000000:0.0:1789778349.655740:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789778349.655743:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789778349.655746:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789778349.655752:0:13314:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b3ec1647000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789778349.655757:0:13314:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9b3e91fe3370) has exports, disconnecting them 00000020:00080000:0.0:1789778349.655761:0:13314:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b3ec1647000), last request at 1789778154 00000020:00000080:0.0:1789778349.655765:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440c62 00000020:00080000:0.0:1789778349.655777:0:13314:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3ec1647000): rc 0 00000020:00000080:0.0:1789778349.655780:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3ec1647000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789778349.656233:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3e88f48800 for MGC192.168.201.145@tcp 00000020:00000080:3.0:1789778349.656240:0:8:0:(genops.c:885:class_export_put()) final put ffff9b3e84ef2000/a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5 00000020:00000080:3.0:1789778349.656243:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3e84ef2000/a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5 for MGC192.168.201.145@tcp 00000020:01000000:3.0:1789778349.656251:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.145@tcp (a66e0e23-f188-4fdf-8e93-2d9d7d7ce7a5) 00000020:00000080:3.0:1789778349.656503:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec1647000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789778349.659174:0:13314:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789778349.659182:0:13314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789778349.659187:0:13314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789778349.659193:0:13314:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789778349.659356:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b3ec1643000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789778349.669646:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789778349.673099:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1789778349.680251:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b3e8611a400:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1789778349.684769:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b3e956e1800:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1789778349.684998:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.685281:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b3e91b69200:5833] 2 exiting: rc = 0 00000100:00100000:2.0:1789778349.688157:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b3e88c5e200:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1789778349.688243:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b3e91b69800:5832] 1 exiting: rc = 0 00000100:00100000:0.0:1789778349.690682:0:12471:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b3ebf352800:12471] 3 exiting: rc = 0 00000100:00100000:2.0:1789778349.690910:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690919:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690925:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690931:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690937:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690943:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690949:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690955:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690961:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690978:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690984:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690990:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.690996:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691001:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691007:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691014:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691020:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691026:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691032:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691037:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691042:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691047:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691051:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691253:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691259:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691264:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691268:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691273:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691277:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691282:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691286:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691291:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691296:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691301:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691306:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691311:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691316:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691321:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691326:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691332:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691338:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691343:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691347:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691351:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691355:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691359:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691365:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691369:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691373:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691378:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691382:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691388:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691392:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691396:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691401:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691405:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691409:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691414:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691425:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691431:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691436:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691441:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691446:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.691451:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789778349.692526:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789778349.692535:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789778349.692541:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3ec1644000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789778349.692545:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec1644000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789778349.692550:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789778349.692586:0:13314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ebf7c9000 1 00000020:00000080:2.0:1789778349.692591:0:13314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5a1e1c1157440c07 00000020:00000080:2.0:1789778349.692597:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3ec15ac000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789778349.692608:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789778349.692613:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789778349.692617:0:13314:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789778349.692621:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9b3e91fe0000) has no exports 00000020:00000080:2.0:1789778349.693877:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec15ac000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789778349.716674:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789778349.716689:0:13314:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789778349.716694:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3ebf7ca800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789778349.716699:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ebf7ca800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789778349.716706:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789778349.716898:0:13314:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b3ebf7ce000 00000020:01000000:3.0:1789778349.716919:0:13314:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789778349.716923:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789778349.716927:0:13314:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789778349.716931:0:13314:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9b3e85d03370) has no exports 00000020:00000080:3.0:1789778349.716978:0:13314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789778349.716985:0:13314:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789778349.716989:0:13314:0:(genops.c:885:class_export_put()) final put ffff9b3ec13f3800/OSS_uuid 00000020:00000080:3.0:1789778349.716991:0:13314:0:(genops.c:844:class_export_destroy()) destroying export ffff9b3ec13f3800/OSS_uuid for OSS 00000020:01000000:3.0:1789778349.716995:0:13314:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789778349.717024:0:5842:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789778349.717205:0:8205:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b3e98630600:8205] 3 exiting: rc = 0 00000100:00100000:3.0:1789778349.717252:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b3ea01cba00:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1789778349.723291:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b3eb93d8a00:6694] 2 exiting: rc = 0 00000100:00100000:2.0:1789778349.723398:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b3ea01cc600:6693] 1 exiting: rc = 0 00000100:00100000:3.0:1789778349.723849:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723859:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723866:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723873:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723878:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723883:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723888:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723892:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723897:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723902:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723907:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723911:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723916:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723921:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723926:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723930:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723935:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723941:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723946:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723951:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723956:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723961:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723976:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723983:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723987:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723992:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.723997:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724020:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724025:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724030:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724036:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724041:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724046:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724091:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724099:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724104:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724109:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724114:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724120:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724124:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724140:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724146:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724151:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724155:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724159:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724164:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724169:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724173:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724178:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724184:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724190:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724196:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724202:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724207:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724218:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724227:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724236:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724242:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724248:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724252:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724257:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724261:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724272:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.724277:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.726139:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b3ea01cc000:6696] 1 exiting: rc = 0 00000100:00100000:2.0:1789778349.726224:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b3ea01cce00:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1789778349.726380:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726388:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726392:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726398:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726403:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726407:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726412:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726416:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726421:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726426:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726430:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726436:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726441:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726446:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726451:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726456:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726461:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726466:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726472:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726582:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726589:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726593:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726598:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726602:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726608:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726613:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726619:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726624:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726629:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726633:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726639:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726643:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726648:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726667:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726672:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726677:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726682:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726687:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726692:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726697:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726702:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726706:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726711:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726718:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726723:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726729:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726734:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726739:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726744:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726748:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726754:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726760:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726768:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726774:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726779:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726784:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726789:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726794:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726799:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726804:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726810:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726815:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726820:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.726826:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.731816:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b3eb93bf600:6698] 1 exiting: rc = 0 00000100:00100000:1.0:1789778349.732767:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b3eb93be600:6699] 2 exiting: rc = 0 00000100:00100000:2.0:1789778349.735346:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b3eb93be800:6697] 0 exiting: rc = 1 00000100:00100000:3.0:1789778349.735741:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735749:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735755:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735762:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735782:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735788:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735794:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735799:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735815:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735822:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735827:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735842:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735847:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735854:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735861:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735867:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735873:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735879:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735884:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735890:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735896:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735902:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735922:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735929:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735935:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735941:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735946:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735953:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735959:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735965:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735983:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735989:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735994:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.735999:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736006:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736012:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736018:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736024:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736029:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736042:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736047:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736053:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736058:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736087:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736094:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736100:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736119:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736126:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736545:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736551:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736556:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736562:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736567:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736573:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736578:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736584:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736589:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736594:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736599:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736605:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736610:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736615:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736622:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789778349.736629:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.752578:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b3eb93bec00:6701] 1 exiting: rc = 0 00000100:00100000:1.0:1789778349.755990:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b3e98683600:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1789778349.756318:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756327:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756334:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756340:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756345:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756366:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756371:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756377:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756382:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756388:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756393:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756399:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756406:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756412:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756418:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756423:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756429:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756434:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756439:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756445:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756451:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756456:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756461:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756467:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756472:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756488:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756493:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756499:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756505:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756510:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756515:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756520:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756526:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756530:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756535:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756540:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756545:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756550:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756554:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756559:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756571:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756576:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756581:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756586:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756593:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756598:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756603:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756608:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756613:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756619:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756625:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756630:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756640:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756646:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756652:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756658:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756664:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756669:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756675:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756681:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756686:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756691:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756697:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.756702:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789778349.760308:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b3eb9415800:6702] 0 exiting: rc = 1 00000100:00100000:0.0:1789778349.760421:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b3eb9414000:6703] 1 exiting: rc = 0 00000100:00100000:2.0:1789778349.761887:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761922:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761931:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761939:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761945:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761952:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761960:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761977:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761984:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.761990:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762017:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762035:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762041:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762047:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762054:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762061:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762100:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762106:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762113:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762119:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762126:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762431:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762452:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762459:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762465:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762471:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762545:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762553:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762558:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762564:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762571:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762580:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762589:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762596:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762619:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762626:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762632:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762639:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762645:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762650:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762655:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762661:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762668:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762674:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762680:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762686:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762713:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762719:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762725:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762731:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762736:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762742:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762751:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762758:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762766:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762773:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762779:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762785:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762866:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762877:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762883:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762889:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.762957:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789778349.763029:0:13314:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789778349.792111:0:13314:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789778370.072992:0:13928:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789778378.831841:0:14390:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789778378.831846:0:14390:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789778378.831961:0:14390:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b3ec17e1800 00000020:01000004:3.0:1789778378.831975:0:14390:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789778378.831982:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789778378.831996:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b3eb700b370) 00000020:00000080:3.0:1789778378.832009:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789778378.853514:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789778378.855836:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789778378.856225:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1789778378.858549:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:2.0:1789778378.858943:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 517: rc = 0 00100000:10000000:2.0:1789778378.859241:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:2.0:1789778378.859353:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 517: rc = 0 00100000:10000000:2.0:1789778378.859750:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789778378.859803:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 517: rc = 0 00100000:10000000:3.0:1789778378.861975:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 519: rc = 0 00100000:10000000:3.0:1789778378.863708:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 320: rc = 0 00100000:10000000:3.0:1789778378.863815:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 320: rc = 0 00100000:10000000:3.0:1789778378.864709:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 449: rc = 0 00100000:10000000:3.0:1789778378.864948:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 449: rc = 0 00100000:10000000:3.0:1789778378.865745:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 449: rc = 0 00100000:10000000:3.0:1789778378.865983:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 449: rc = 0 00100000:10000000:3.0:1789778378.866504:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 449: rc = 0 00100000:10000000:3.0:1789778378.866819:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 449: rc = 0 00100000:10000000:3.0:1789778378.867275:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 449: rc = 0 00100000:10000000:3.0:1789778378.867604:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 449: rc = 0 00100000:10000000:3.0:1789778378.867950:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 449: rc = 0 00100000:10000000:3.0:1789778378.868458:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 449: rc = 0 00100000:10000000:3.0:1789778378.868777:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 449: rc = 0 00100000:10000000:3.0:1789778378.869022:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 449: rc = 0 00100000:10000000:3.0:1789778378.869855:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 87: rc = 0 00100000:10000000:3.0:1789778378.870420:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 87: rc = 0 00100000:10000000:3.0:1789778378.870745:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 87: rc = 0 00100000:10000000:3.0:1789778378.871004:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 87: rc = 0 00100000:10000000:3.0:1789778378.871472:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 87: rc = 0 00100000:10000000:3.0:1789778378.871829:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 87: rc = 0 00100000:10000000:3.0:1789778378.872219:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 87: rc = 0 00100000:10000000:3.0:1789778378.872555:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 87: rc = 0 00100000:10000000:3.0:1789778378.872844:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 87: rc = 0 00100000:10000000:3.0:1789778378.873174:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 87: rc = 0 00100000:10000000:3.0:1789778378.873486:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 87: rc = 0 00100000:10000000:3.0:1789778378.873738:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 87: rc = 0 00100000:10000000:3.0:1789778378.873959:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 87: rc = 0 00100000:10000000:3.0:1789778378.874463:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 87: rc = 0 00100000:10000000:3.0:1789778378.874757:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 87: rc = 0 00100000:10000000:3.0:1789778378.875006:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 87: rc = 0 00100000:10000000:3.0:1789778378.875464:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 87: rc = 0 00100000:10000000:3.0:1789778378.875774:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 87: rc = 0 00100000:10000000:3.0:1789778378.876017:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 87: rc = 0 00100000:10000000:3.0:1789778378.876506:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 87: rc = 0 00100000:10000000:3.0:1789778378.876883:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 87: rc = 0 00100000:10000000:3.0:1789778378.877148:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 87: rc = 0 00100000:10000000:3.0:1789778378.877484:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 87: rc = 0 00100000:10000000:3.0:1789778378.877998:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 87: rc = 0 00100000:10000000:3.0:1789778378.878389:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 87: rc = 0 00100000:10000000:3.0:1789778378.878635:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 87: rc = 0 00100000:10000000:3.0:1789778378.878856:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 87: rc = 0 00100000:10000000:3.0:1789778378.879135:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 87: rc = 0 00100000:10000000:3.0:1789778378.879385:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 87: rc = 0 00100000:10000000:3.0:1789778378.879612:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 87: rc = 0 00100000:10000000:3.0:1789778378.879835:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 87: rc = 0 00100000:10000000:3.0:1789778378.880105:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 87: rc = 0 00100000:10000000:3.0:1789778378.880454:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 326: rc = 0 00100000:10000000:3.0:1789778378.880920:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789778378.881093:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 447: rc = 0 00100000:10000000:3.0:1789778378.881273:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789778378.882436:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 447: rc = 0 00100000:10000000:3.0:1789778378.882767:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789778378.882835:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 447: rc = 0 00100000:10000000:3.0:1789778378.883215:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789778378.883277:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 321: rc = 0 00100000:10000000:3.0:1789778378.883581:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789778378.883663:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 321: rc = 0 00100000:10000000:3.0:1789778378.883853:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789778378.883925:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 321: rc = 0 00000020:00000080:3.0:1789778378.884217:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789778378.884225:0:14390:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789778378.884235:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157441d2c 00000020:01000004:3.0:1789778378.884244:0:14390:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789778378.884248:0:14390:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789778378.884253:0:14390:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3ec17e1800 from MGS 00000020:01000004:3.0:1789778378.884257:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789778378.884266:0:14390:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b3eb700cd28) 00000020:00000080:3.0:1789778378.884275:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789778378.884474:0:14390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ec17e1800 from MGS, refs=2 00080000:01000000:3.0:1789778378.884479:0:14390:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789778378.884485:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157441d3a 00000100:00100000:3.0:1789778378.884577:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789778378.884773:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789778378.884779:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789778378.887675:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789778378.887689:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789778378.888514:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789778378.888774:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789778378.888780:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789778378.889282:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789778378.889288:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789778378.889700:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789778378.889707:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789778378.890473:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778378.890477:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778378.890479:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778378.890787:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778378.890789:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778378.890796:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778378.891258:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789778378.895740:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789778378.903462:0:14390:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789778378.903477:0:14390:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789778378.903480:0:14390:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789778378.908264:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789778378.908532:0:14390:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789778378.908784:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789778378.909521:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789778378.909834:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778378.909994:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789778378.910000:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789778378.911418:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789778378.911427:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789778378.911794:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789778378.911800:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789778378.912869:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789778378.912889:0:14390:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.145@tcp' 00000020:01000004:0.0:1789778378.912891:0:14390:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789778378.912920:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.145@tcp (typ=mgc) 00000020:00000080:0.0:1789778378.912932:0:14390:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.145@tcp (ffff9b3eb9770000) 00000020:00000080:0.0:1789778378.912953:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789778378.913024:0:14390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3eac5d8000@MGC192.168.201.145@tcp: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1789778378.913227:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.145@tcp-0 is initialized 00000040:01000000:0.0:1789778378.913234:0:14390:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789778378.913627:0:14404:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789778378.914133:0:14405:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789778378.914157:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.145@tcp (uuid 3d019c5f-5be2-4a6f-8e9a-7a584eb56713) 00000020:00000080:0.0:1789778378.914172:0:14390:0:(genops.c:1385:class_connect()) connect: client 3d019c5f-5be2-4a6f-8e9a-7a584eb56713, cookie 0x5a1e1c1157441d48 00000100:00080000:0.0:1789778378.914182:0:14390:0:(import.c:510:import_select_connection()) MGC192.168.201.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789778378.914187:0:14390:0:(import.c:624:import_select_connection()) MGC192.168.201.145@tcp: import ffff9b3eac5d8000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1789778378.914216:0:14390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ec17ab480 x1876718314932992/t0(0) o250->MGC192.168.201.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789778378.914240:0:14390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3d019c5f-5be2-4a6f-8e9a-7a584eb56713->MGS 00000020:01000004:0.0:1789778378.914260:0:14390:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789778378.914264:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789778378.914275:0:14390:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b3eb9774d28) 00000020:00000080:0.0:1789778378.914284:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789778378.915414:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3309:1876718314932992:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789778378.915483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778378.915550:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314932992 00000100:00100000:3.0:1789778378.915557:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314932992 00000100:00100000:3.0:1789778378.915585:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778378.915592:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1876718314932992:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789778378.915682:0:14401:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3d019c5f-5be2-4a6f-8e9a-7a584eb56713@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:3.0:1789778378.915710:0:14401:0:(genops.c:1385:class_connect()) connect: client 3d019c5f-5be2-4a6f-8e9a-7a584eb56713, cookie 0x5a1e1c1157441d56 00000100:00080000:3.0:1789778378.915828:0:14401:0:(import.c:65:import_set_state_nolock()) ffff9b3ec0cc9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789778378.915880:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+5:3309:x1876718314932992:12345-0@lo:250:mount.lustre.0 Request processed in 286us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778378.915887:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778378.915930:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789778378.915938:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.145@tcp: connect to target with instance 0 00000100:00080000:3.0:1789778378.915945:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789778378.915949:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789778378.915952:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3eac5d8000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789778378.915954:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789778378.915958:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789778378.915962:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3309:1876718314932992:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789778378.926759:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778378.926960:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789778378.926967:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789778378.927678:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789778378.927685:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789778378.930904:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789778378.930916:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789778378.933568:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778378.933864:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789778378.933870:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789778378.934463:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789778378.934470:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789778378.970791:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789778378.971003:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789778378.971010:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789778378.972037:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789778378.972048:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789778378.972783:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778378.972957:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789778378.972962:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789778378.973611:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789778378.973619:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789778378.974385:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778378.974529:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789778378.974533:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789778378.974975:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789778378.974980:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789778378.975756:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778378.975915:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789778378.975919:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789778378.976474:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789778378.976480:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789778378.997784:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789778378.998194:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789778378.998203:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789778378.999824:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789778378.999836:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789778379.001455:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789778379.001551:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789778379.002583:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789778379.002606:0:14390:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789778379.002613:0:14390:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789778379.002810:0:14390:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789778379.002844:0:14390:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789778379.002849:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789778379.002850:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778379.002851:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778379.002852:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778379.002853:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778379.002855:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778379.002856:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778379.002862:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778379.002863:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778379.002864:0:14390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789778379.002867:0:14390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789778379.002869:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789778379.002870:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778379.002871:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778379.002872:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778379.002872:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778379.002873:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778379.002874:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778379.002875:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778379.002876:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778379.002877:0:14390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789778379.002902:0:14390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789778379.002921:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933120:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789778379.003059:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.003514:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.003553:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314933120 00000100:00100000:3.0:1789778379.003561:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314933120 00000100:00100000:3.0:1789778379.003649:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789778379.003660:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+5:14390:x1876718314933120:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789778379.003724:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789778379.003727:0:14403:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789778379.003729:0:14403:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789778379.004628:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789778379.005483:0:14403:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789778379.006770:0:14424:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789778379.006777:0:14424:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789778379.006779:0:14424:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789778379.006817:0:14424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789778379.007496:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789778379.007509:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789778379.018438:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+5:14390:x1876718314933120:12345-0@lo:253:mount.lustre.0 Request processed in 14770us (15370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.018470:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778379.018563:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933120:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789778379.018579:0:14390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789778379.018582:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789778379.018584:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789778379.018585:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778379.018587:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778379.018588:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778379.018589:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778379.018591:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789778379.018592:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789778379.018594:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778379.018595:0:14390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789778379.018618:0:14390:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3ec17e1800 from lustre-MDT0000 10000000:01000000:2.0:1789778379.018644:0:14390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789778379.018647:0:14390:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789778379.018656:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b3eb9770000 10000000:01000000:2.0:1789778379.018661:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778379.018669:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b3eb9770000 from 1 10000000:01000000:2.0:1789778379.018672:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789778379.018773:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.018784:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.018793:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.018811:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778379.018864:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.018947:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.018998:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314933248 00000100:00100000:3.0:1789778379.019005:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314933248 00000100:00100000:3.0:1789778379.019112:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789778379.019122:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+5:14390:x1876718314933248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778379.019134:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778379.019149:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44c200/0x5a1e1c1157441d64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441d5d expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.019171:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44c200/0x5a1e1c1157441d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441d5d expref: 6 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.019181:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44c200/0x5a1e1c1157441d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441d5d expref: 6 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.019189:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c200, rc 0) 00000100:00100000:3.0:1789778379.019474:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+6:14390:x1876718314933248:12345-0@lo:101:mount.lustre.0 Request processed in 352us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.019480:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789778379.019892:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778379.019908:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.019917:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.019973:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778379.020005:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.021307:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789778379.021576:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314933376 00000100:00100000:1.0:1789778379.021585:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314933376 00000100:00100000:1.0:1789778379.021626:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778379.021635:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+6:14390:x1876718314933376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789778379.021949:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+6:14390:x1876718314933376:12345-0@lo:501:mount.lustre.0 Request processed in 313us (1942us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789778379.021964:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789778379.022397:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933376:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789778379.022432:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789778379.022494:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.022505:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778379.022514:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3ec17e1800 10000000:01000000:2.0:1789778379.022519:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789778379.022523:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b3ec17e1800 10000000:01000000:2.0:1789778379.022525:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789778379.022529:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b3ec17e1800 from 1 10000000:01000000:2.0:1789778379.022531:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789778379.022560:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9400/0x5a1e1c1157441d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.022567:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9400/0x5a1e1c1157441d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.022578:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9400/0x5a1e1c1157441d6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.022596:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778379.022630:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.022664:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.022813:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314933504 00000100:00100000:3.0:1789778379.022819:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314933504 00000100:00100000:3.0:1789778379.022852:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789778379.022860:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+6:14390:x1876718314933504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778379.022869:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778379.022883:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44ce00/0x5a1e1c1157441d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441d6b expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.022903:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44ce00/0x5a1e1c1157441d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441d6b expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.022920:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44ce00/0x5a1e1c1157441d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441d6b expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.022928:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44ce00, rc 0) 00000100:00100000:3.0:1789778379.022968:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+7:14390:x1876718314933504:12345-0@lo:101:mount.lustre.0 Request processed in 109us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.022974:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778379.023046:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778379.023057:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9400/0x5a1e1c1157441d6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d72 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.023084:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9400/0x5a1e1c1157441d6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441d72 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778379.023167:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789778379.023413:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9400/0x5a1e1c1157441d6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d72 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.023422:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9400/0x5a1e1c1157441d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d72 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778379.023429:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789778379.023433:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778379.023438:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b3ec17e1800 10000000:01000000:2.0:1789778379.023441:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789778379.023444:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789778379.023446:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789778379.023461:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8200/0x5a1e1c1157441d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.023468:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8200/0x5a1e1c1157441d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.023475:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8200/0x5a1e1c1157441d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.023488:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778379.023516:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.023544:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.023594:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314933632 00000100:00100000:3.0:1789778379.023598:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314933632 00000100:00100000:3.0:1789778379.023622:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789778379.023629:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+7:14390:x1876718314933632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778379.023637:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778379.023646:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44dc00/0x5a1e1c1157441d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441d79 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.023660:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44dc00/0x5a1e1c1157441d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441d79 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.023669:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44dc00/0x5a1e1c1157441d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441d79 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.023676:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44dc00, rc 0) 00000100:00100000:3.0:1789778379.023772:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+8:14390:x1876718314933632:12345-0@lo:101:mount.lustre.0 Request processed in 143us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.023778:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789778379.023849:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778379.023859:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8200/0x5a1e1c1157441d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d80 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.023873:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8200/0x5a1e1c1157441d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441d80 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.023919:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778379.023942:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.023964:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.024012:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314933760 00000100:00100000:3.0:1789778379.024016:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314933760 00000100:00100000:3.0:1789778379.024051:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789778379.024057:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+8:14390:x1876718314933760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789778379.024801:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14390:x1876718314933760:12345-0@lo:501:mount.lustre.0 Request processed in 741us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.024809:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789778379.024965:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778379.025000:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778379.025040:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.025229:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.025394:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314933888 00000100:00100000:3.0:1789778379.025399:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314933888 00000100:00100000:3.0:1789778379.025466:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789778379.025474:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14390:x1876718314933888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789778379.025969:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14390:x1876718314933888:12345-0@lo:503:mount.lustre.0 Request processed in 495us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.025977:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789778379.026057:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314933888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789778379.026576:0:14425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14425:1876718314934016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778379.026616:0:14425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778379.026955:0:14425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf903a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.026999:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314934016 00000100:00100000:2.0:1789778379.027004:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314934016 00000100:00100000:2.0:1789778379.027034:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789778379.027043:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14425:x1876718314934016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778379.030528:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14425:x1876718314934016:12345-0@lo:502:llog_process_th.0 Request processed in 3477us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.030541:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789778379.030653:0:14425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14425:1876718314934016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789778379.030800:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778379.030812:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778379.030814:0:14425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789778379.030819:0:14425:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789778379.030822:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778379.030836:0:14425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b3eb9773370) 00000020:00000080:0.0:1789778379.030854:0:14425:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789778379.030859:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789778379.030933:0:14425:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789778379.030939:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157441d8e 00000020:00000080:0.0:1789778379.031521:0:14425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789778379.031526:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778379.031530:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778379.031532:0:14425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789778379.031535:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778379.031539:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778379.031540:0:14425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789778379.031543:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778379.031550:0:14425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b3eb97719b8) 00000020:00000080:0.0:1789778379.031635:0:14425:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789778379.031642:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789778379.031644:0:14425:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789778379.031647:0:14425:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789778379.031653:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789778379.031756:0:14425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ec17e1800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789778379.031772:0:14425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b3e85d03370) 00000020:00000080:0.0:1789778379.031781:0:14425:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789778379.031826:0:14425:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789778379.031832:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157441da3 00000020:00000080:0.0:1789778379.031929:0:14425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789778379.031935:0:14425:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789778379.031948:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5a1e1c1157441daa 00080000:01000000:0.0:1789778379.031954:0:14425:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789778379.031957:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157441db1 00010000:00010000:2.0:1789778379.123489:0:14425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789778379.124513:0:14425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789778379.124874:0:14425:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789778379.126287:0:14425:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b3ebf7d3370) 00000020:00000080:2.0:1789778379.126380:0:14425:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789778379.126447:0:14425:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789778379.126453:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157441dbf 00000020:00000080:2.0:1789778379.134845:0:14425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789778379.141033:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5a1e1c1157441dc6 00000020:00000080:1.0:1789778379.142428:0:14425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789778379.142440:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778379.142447:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.142449:0:14425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789778379.142453:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778379.142459:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.142460:0:14425:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789778379.142465:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789778379.142502:0:14425:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789778379.142522:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778379.142525:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.142526:0:14425:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789778379.142529:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789778379.142531:0:14425:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789778379.142533:0:14425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789778379.142534:0:14425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789778379.142536:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789778379.142538:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.142540:0:14425:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789778379.142542:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789778379.142545:0:14425:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789778379.142548:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.142550:0:14425:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789778379.142553:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789778379.142863:0:14425:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:1.0:1789778379.142890:0:14425:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789778379.142893:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789778379.142906:0:14425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b3e91fe19b8) 00000020:00000080:1.0:1789778379.142921:0:14425:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789778379.142925:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789778379.142985:0:14425:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789778379.142990:0:14425:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789778379.142997:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157441dd4 00010000:00080000:1.0:1789778379.143025:0:14425:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3ec1647000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1789778379.143559:0:14425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789778379.143988:0:14425:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789778379.144032:0:14425:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789778379.145883:0:14425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778379.145941:0:14425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789778379.146006:0:14425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789778379.146762:0:14429:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789778379.146767:0:14429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789778379.151436:0:14425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789778379.151449:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789778379.151480:0:14425:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789778379.151494:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157441ddb 00000100:00080000:1.0:1789778379.151503:0:14425:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789778379.151507:0:14425:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b3ec1647000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1789778379.151536:0:14425:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3d822f3100 x1876718314934144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789778379.151559:0:14425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789778379.151659:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778379.151671:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314934272:0@lo:400:kworker.0 00000100:00100000:2.0:1789778379.151847:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778379.151924:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314934144:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789778379.151954:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876718314934144 offset 0 length 520: 4 00000100:00100000:0.0:1789778379.151974:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314934272 00000100:00100000:0.0:1789778379.151981:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314934272 00000100:00100000:0.0:1789778379.152107:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789778379.152118:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:3311:x1876718314934272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778379.152164:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:3311:x1876718314934272:12345-0@lo:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778379.152171:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789778379.152330:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314934272:0@lo:400:kworker.0 00000020:01000000:1.0:1789778379.152734:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778379.152742:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.152744:0:14425:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789778379.152748:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789778379.152750:0:14425:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789778379.152751:0:14425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789778379.152752:0:14425:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789778379.152753:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789778379.152755:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.152756:0:14425:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789778379.152757:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789778379.152761:0:14425:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789778379.152762:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.152774:0:14425:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789778379.152777:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789778379.152780:0:14425:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.145@tcp to nid 0x20000c0a8c991 (192.168.201.145@tcp) 00000020:01000000:1.0:1789778379.152795:0:14425:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789778379.152797:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789778379.152807:0:14425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b3e91fe0000) 00000020:00000080:1.0:1789778379.152816:0:14425:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789778379.152819:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789778379.152866:0:14425:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789778379.152871:0:14425:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789778379.152874:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5a1e1c1157441de9 00010000:00080000:1.0:1789778379.152907:0:14425:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3e88d7f000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:1.0:1789778379.153383:0:14425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789778379.153539:0:14425:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789778379.153554:0:14425:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789778379.154593:0:14425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778379.154651:0:14425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789778379.155373:0:14425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789778379.156496:0:14431:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789778379.156502:0:14431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789778379.161632:0:14425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789778379.161649:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789778379.161698:0:14425:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789778379.161718:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157441df0 00000100:00080000:1.0:1789778379.161729:0:14425:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789778379.161734:0:14425:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3e88d7f000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1789778379.161769:0:14425:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3d822f1180 x1876718314934400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789778379.161798:0:14425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789778379.161951:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314934400:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789778379.162005:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876718314934400 offset 0 length 520: 4 00000020:01000000:1.0:1789778379.162456:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778379.162463:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.162465:0:14425:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789778379.162483:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778379.162487:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.162488:0:14425:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789778379.162492:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789778379.162494:0:14425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789778379.162496:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778379.162498:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.162500:0:14425:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789778379.162502:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778379.162504:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.162505:0:14425:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789778379.162509:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789778379.162538:0:14425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14425:1876718314934528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789778379.162587:0:14425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778379.162608:0:14425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e8503fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778379.162778:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314934528 00000100:00100000:0.0:1789778379.162785:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314934528 00000100:00100000:0.0:1789778379.162835:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789778379.162845:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14425:x1876718314934528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789778379.163489:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14425:x1876718314934528:12345-0@lo:502:llog_process_th.0 Request processed in 643us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778379.163499:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789778379.163573:0:14425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14425:1876718314934528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789778379.163614:0:14425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778379.163620:0:14425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778379.163622:0:14425:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789778379.163626:0:14425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789778379.163997:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789778379.164016:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789778379.164098:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8200/0x5a1e1c1157441d79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d80 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.164111:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8200/0x5a1e1c1157441d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d80 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778379.164120:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3ec17e1800 from 1 10000000:01000000:0.0:1789778379.164123:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789778379.164158:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.164165:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.164174:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778379.164190:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314934656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789778379.164227:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778379.164268:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf903600 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.164504:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314934656 00000100:00100000:3.0:1789778379.164510:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314934656 00000100:00100000:3.0:1789778379.164556:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789778379.164565:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+9:14390:x1876718314934656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778379.164576:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778379.164591:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441df7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.164624:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.164634:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.164643:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44c600, rc 0) 00000100:00100000:3.0:1789778379.164675:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+10:14390:x1876718314934656:12345-0@lo:101:mount.lustre.0 Request processed in 112us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.164682:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789778379.164817:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314934656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789778379.164830:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.164838:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778379.165586:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314934784:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789778379.165636:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778379.165663:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf903600 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.165872:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314934784 00000100:00100000:2.0:1789778379.165879:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314934784 00000100:00100000:2.0:1789778379.165922:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789778379.165930:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+10:14390:x1876718314934784:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789778379.165946:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789778379.165952:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789778379.166024:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+10:14390:x1876718314934784:12345-0@lo:256:mount.lustre.0 Request processed in 94us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.166031:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789778379.166229:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314934784:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789778379.166910:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789778379.167134:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.167146:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778379.167166:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ec17e1800 from 1 10000000:01000000:0.0:1789778379.167169:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778379.167198:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.167206:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.167216:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778379.167234:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314934912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789778379.167278:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778379.167404:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf903600 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.167468:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314934912 00000100:00100000:3.0:1789778379.167474:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314934912 00000100:00100000:3.0:1789778379.167554:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789778379.167563:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+10:14390:x1876718314934912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778379.167574:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778379.167587:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441e05 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.167606:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.167617:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.167624:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d800, rc 0) 00000100:00100000:3.0:1789778379.167665:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14390:x1876718314934912:12345-0@lo:101:mount.lustre.0 Request processed in 104us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.167672:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789778379.167758:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314934912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789778379.167770:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778379.167779:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778379.167826:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789778379.167850:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778379.167980:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf903600 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.168050:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935040 00000100:00100000:2.0:1789778379.168055:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935040 00000100:00100000:2.0:1789778379.168097:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789778379.168104:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14390:x1876718314935040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778379.168651:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14390:x1876718314935040:12345-0@lo:501:mount.lustre.0 Request processed in 545us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.168659:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789778379.168837:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789778379.168873:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789778379.168916:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778379.168986:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf903600 going to sleep for 11 seconds 00000100:00100000:1.0:1789778379.169045:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935168 00000100:00100000:1.0:1789778379.169050:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935168 00000100:00100000:2.0:1789778379.169118:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789778379.169127:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14390:x1876718314935168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778379.169325:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14390:x1876718314935168:12345-0@lo:503:mount.lustre.0 Request processed in 199us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.169332:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789778379.169517:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789778379.170006:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14433:1876718314935296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778379.170051:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778379.170192:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421900 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.170270:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935296 00000100:00100000:2.0:1789778379.170275:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935296 00000100:00100000:2.0:1789778379.170419:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789778379.170428:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14433:x1876718314935296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778379.170668:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14433:x1876718314935296:12345-0@lo:502:llog_process_th.0 Request processed in 241us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.170675:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789778379.170811:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14433:1876718314935296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778379.170837:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778379.170845:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778379.170848:0:14433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789778379.170854:0:14433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ec17e1800 00000020:00000080:3.0:1789778379.170857:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789778379.170864:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778379.170866:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778379.170868:0:14433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789778379.170870:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778379.170873:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778379.170874:0:14433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789778379.170877:0:14433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ec17e1800 00000020:00000080:3.0:1789778379.170879:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789778379.170976:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778379.170981:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778379.170982:0:14433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789778379.170985:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778379.170987:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778379.170989:0:14433:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789778379.170992:0:14433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3ec17e1800 00000020:00000080:3.0:1789778379.170994:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789778379.172539:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14433:1876718314935424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778379.172602:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778379.173379:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421900 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.175164:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935424 00000100:00100000:2.0:1789778379.175176:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935424 00000100:00100000:2.0:1789778379.177825:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789778379.177846:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14433:x1876718314935424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778379.178115:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14433:x1876718314935424:12345-0@lo:502:llog_process_th.0 Request processed in 277us (5511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.178125:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789778379.181442:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14433:1876718314935424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789778379.181485:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778379.181496:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778379.181498:0:14433:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789778379.181503:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789778379.182521:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789778379.182545:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789778379.182570:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.182582:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778379.182624:0:14390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789778379.182627:0:14390:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3ec17e1800 10000000:01000000:2.0:1789778379.182629:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3ec17e1800 10000000:01000000:2.0:1789778379.182633:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778379.182639:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3ec17e1800 from 1 10000000:01000000:2.0:1789778379.182641:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789778379.182679:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9000/0x5a1e1c1157441e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.183786:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9000/0x5a1e1c1157441e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.183801:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9000/0x5a1e1c1157441e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.183826:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778379.183887:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.183923:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfbf46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.183949:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935552 00000100:00100000:2.0:1789778379.183955:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935552 00000100:00100000:2.0:1789778379.183996:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789778379.184005:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14390:x1876718314935552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778379.184019:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778379.184034:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e833f8400/0x5a1e1c1157441e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441e13 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.184057:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e833f8400/0x5a1e1c1157441e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441e13 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.184083:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e833f8400/0x5a1e1c1157441e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e13 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.184092:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e833f8400, rc 0) 00000100:00100000:2.0:1789778379.184128:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14390:x1876718314935552:12345-0@lo:101:mount.lustre.0 Request processed in 124us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.184135:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789778379.184188:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778379.184202:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9000/0x5a1e1c1157441e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e1a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.184211:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9000/0x5a1e1c1157441e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441e1a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.184258:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778379.184281:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.185158:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86182b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.185177:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935680 00000100:00100000:2.0:1789778379.185182:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935680 00000100:00100000:2.0:1789778379.185270:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789778379.185279:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14390:x1876718314935680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778379.187670:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14390:x1876718314935680:12345-0@lo:501:mount.lustre.0 Request processed in 2385us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.187683:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789778379.190837:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778379.190898:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778379.190963:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.191007:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86182b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.191026:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935808 00000100:00100000:2.0:1789778379.191032:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935808 00000100:00100000:2.0:1789778379.191104:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789778379.191114:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14390:x1876718314935808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778379.193447:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14390:x1876718314935808:12345-0@lo:503:mount.lustre.0 Request processed in 177us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.193466:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789778379.193560:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314935808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778379.194358:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14438:1876718314935936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778379.194424:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.194465:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86182e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778379.194511:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314935936 00000100:00100000:3.0:1789778379.194518:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314935936 00000100:00100000:3.0:1789778379.194560:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789778379.194570:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14438:x1876718314935936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789778379.194861:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14438:x1876718314935936:12345-0@lo:502:llog_process_th.0 Request processed in 291us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.194869:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789778379.194944:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14438:1876718314935936:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789778379.195001:0:14438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789778379.195016:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b3ebf7d4d28) 00000020:00000080:2.0:1789778379.195036:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789778379.195142:0:14438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ec17e1800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789778379.195146:0:14438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3ec17e1800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789778379.195149:0:14438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ec17e1800 4 00010000:00080000:2.0:1789778379.195185:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3e873a9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.145@tcp at head 00010000:00010000:2.0:1789778379.204485:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789778379.206918:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789778379.206956:0:14438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789778379.206969:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5a1e1c1157441e28 00000100:00080000:2.0:1789778379.206979:0:14438:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789778379.206986:0:14438:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b3e873a9000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:2.0:1789778379.207019:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3eb94b1c00 x1876718314936064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789778379.207048:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789778379.207179:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314936064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789778379.207246:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.207633:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14438:1876718314936192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778379.207680:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.207772:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936192 00000100:00100000:2.0:1789778379.207784:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936192 00000100:00100000:2.0:1789778379.207819:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789778379.207828:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14438:x1876718314936192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789778379.208045:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14438:x1876718314936192:12345-0@lo:502:llog_process_th.0 Request processed in 216us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.208053:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789778379.208198:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86182480 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.208219:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14438:1876718314936192:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789778379.208245:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789778379.208465:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789778379.208488:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789778379.208502:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9000/0x5a1e1c1157441e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e1a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.208513:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9000/0x5a1e1c1157441e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e1a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789778379.208553:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789778379.208555:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789778379.208557:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789778379.208558:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789778379.208559:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789778379.208561:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789778379.208562:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789778379.208564:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789778379.208565:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789778379.208566:0:14390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789778379.208569:0:14390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789778379.208572:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789778379.208576:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789778379.208577:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789778379.208579:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789778379.208580:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789778379.208581:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789778379.208582:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789778379.208583:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789778379.208584:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789778379.208585:0:14390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789778379.208598:0:14390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789778379.208608:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314936320:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789778379.208639:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778379.208666:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421180 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.208799:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936320 00000100:00100000:2.0:1789778379.208804:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936320 00000100:00100000:2.0:1789778379.208830:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789778379.208837:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14390:x1876718314936320:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789778379.208855:0:14401:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789778379.208867:0:14401:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789778379.209971:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936064 00000100:00100000:0.0:1789778379.209981:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936064 00000100:00100000:0.0:1789778379.210008:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789778379.210014:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876718314936064:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789778379.210098:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876718314936064:12345-0@lo:38:llog_process_th.0 Request processed in 83us (2852us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789778379.210105:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778379.215114:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789778379.215125:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3e873a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789778379.215133:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789778379.215137:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314936064:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789778379.243586:0:14401:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789778379.243606:0:14401:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789778379.243706:0:14423:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789778379.243711:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789778379.243734:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.243752:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.243761:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.243799:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778379.243813:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 12 pid: 14402 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778379.243847:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14423:1876718314936448:0@lo:104: 00000100:00100000:3.0:1789778379.243906:0:14423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778379.243952:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebf421b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789778379.244100:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936448 00000100:00100000:2.0:1789778379.244108:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936448 00000100:00100000:2.0:1789778379.244154:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778379.244164:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14423:x1876718314936448:12345-0@lo:104: 00010000:00010000:2.0:1789778379.244176:0:14391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244229:0:14391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789778379.244235:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14423:x1876718314936448:12345-0@lo:104: Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.244242:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789778379.244269:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778379.244274:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244282:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778379.244297:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244315:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778379.244322:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778379.244328:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778379.244356:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244363:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778379.244382:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244389:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756c00/0x5a1e1c1157441df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441dfe expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244404:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778379.244406:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778379.244408:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778379.244425:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314936576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778379.244454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778379.244508:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936576 00000100:00100000:2.0:1789778379.244512:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936576 00010000:00010000:2.0:1789778379.244528:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 13 pid: 14402 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.244549:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778379.244555:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+13:3311:x1876718314936576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778379.244565:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778379.244569:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 13 pid: 14402 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244580:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 13 pid: 14402 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244595:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244604:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789778379.244615:0:14393:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000905002s 00010000:00010000:2.0:1789778379.244619:0:14393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244626:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244632:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244638:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244653:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778379.244658:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244665:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244673:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244682:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778379.244723:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+13:3311:x1876718314936576:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778379.244730:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789778379.244762:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314936576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778379.244786:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ebf44c600/0x5a1e1c1157441dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157441df7 expref: 12 pid: 14402 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778379.244796:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14423:1876718314936448:0@lo:104: 00010000:00010000:2.0:1789778379.244807:0:14423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244816:0:14423:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244822:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778379.244838:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ebf44d200/0x5a1e1c1157441e2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778379.258262:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14390:x1876718314936320:12345-0@lo:253:mount.lustre.0 Request processed in 49415us (49612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778379.258278:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789778379.258444:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14390:1876718314936320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789778379.258460:0:14390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789778379.258464:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789778379.258465:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789778379.258466:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778379.258468:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778379.258469:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778379.258470:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778379.258472:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789778379.258473:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789778379.258475:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778379.258476:0:14390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789778379.258490:0:14390:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789778379.267276:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778379.267627:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789778379.267916:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778379.268092:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789778379.268486:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778379.268637:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789778379.269746:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778379.269911:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789778379.270206:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778379.270556:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789778379.270866:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789778379.271018:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789778379.296006:0:14390:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789778379.296507:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789778379.296794:0:14446:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789778379.296799:0:14446:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789778379.296930:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789778379.296996:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789778379.300976:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789778379.301035:0:14447:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789778379.301039:0:14447:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1789778379.302033:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789778379.302250:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789778379.302891:0:14390:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789778379.302900:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789778379.303026:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789778379.306215:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789778379.306898:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789778379.306933:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789778379.308655:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789778379.324353:0:14390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789778379.369113:0:14390:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789778379.369158:0:14390:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf4300d17988 00100000:10000000:3.0:1789778379.369166:0:14390:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789778379.369930:0:14390:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789778379.369949:0:14390:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789778379.369966:0:14390:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789778379.369991:0:14390:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789778379.955350:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778380.211204:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789778380.914125:0:14405:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789778380.914134:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3ec17e1800 from 6 10000000:01000000:2.0:1789778380.914139:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789778380.914180:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778380.914192:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778380.914202:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778380.914229:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314936704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789778380.914307:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778380.914358:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86182240 going to sleep for 11 seconds 00000100:00100000:0.0:1789778380.914430:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936704 00000100:00100000:0.0:1789778380.914438:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936704 00000100:00100000:0.0:1789778380.914560:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789778380.914571:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14405:x1876718314936704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778380.914678:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778380.914694:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441e36 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778380.914716:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778380.914726:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778380.914735:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757400, rc 0) 00000100:00100000:0.0:1789778380.914817:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314936704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778380.914824:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789778380.918809:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314936704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778380.918842:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778380.918856:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778380.919004:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314936832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789778380.919144:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778380.921242:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e86182240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778380.928667:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936832 00000100:00100000:1.0:1789778380.928681:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936832 00000100:00100000:1.0:1789778380.928744:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778380.928755:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314936832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789778380.928783:0:14401:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789778380.928805:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789778380.928809:0:14401:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789778380.929055:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314936832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 301us (9910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778380.929088:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778380.929140:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314936832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789778380.929192:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789778380.929201:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778380.929211:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778380.977302:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789778381.238883:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789778382.001242:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778383.025711:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778384.049257:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789778384.227953:0:14690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1789778384.306131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789778384.306139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789778384.306142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789778384.306145:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789778384.306147:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789778384.306150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789778384.306154:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b3e873a9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789778384.306167:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b3e873a9000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1789778384.306170:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314936960:0@lo:400:kworker.0 00000100:00100000:2.0:1789778384.306192:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3eb94b3b80 x1876718314937088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789778384.306250:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314937088:0@lo:38:kworker.0 00000100:00100000:1.0:1789778384.309354:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778384.310374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778384.310564:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314937088 00000100:00100000:3.0:1789778384.310573:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314937088 00000100:00100000:3.0:1789778384.310647:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789778384.310664:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876718314937088:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789778384.310691:0:14409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1789778384.310729:0:14409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5a1e1c1157441e44 00000004:00100000:3.0:1789778384.310751:0:14409:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789778384.310878:0:14409:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7c7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789778384.310931:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876718314937088:12345-0@lo:38:kworker.0 Request processed in 267us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778384.310939:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789778384.311231:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3eb94b3b80 x1876718314937088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789778394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789778384.311247:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789778384.311254:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789778384.311259:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789778384.311261:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3e873a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789778384.311267:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876718314937088:0@lo:38:kworker.0 00000100:00100000:0.0:1789778384.313058:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314936960 00000100:00100000:0.0:1789778384.313088:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314936960 00000100:00100000:0.0:1789778384.313138:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789778384.313147:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:3312:x1876718314936960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778384.313236:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:3312:x1876718314936960:12345-0@lo:400:kworker.0 Request processed in 89us (3889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778384.313262:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789778384.313316:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314936960:0@lo:400:kworker.0 00010000:00010000:3.0:1789778385.080090:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778386.097978:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778387.122232:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789778387.123938:0:14840:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd394898d0 20000000:00000080:2.0:1789778387.123952:0:14840:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3ec17cd400 uarg=0000000000000000 20000000:01000000:2.0:1789778387.123982:0:14840:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789778387.123989:0:14840:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789778387.123993:0:14840:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789778387.124794:0:14841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789778387.124940:0:14840:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789778387.139352:0:14840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789778387.139457:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778387.139531:0:14840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778387.139551:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778387.139589:0:14840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778387.139604:0:14840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 11 pid: 14401 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778387.139619:0:14840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14840:1876718314937216:0@lo:104: 00000100:00100000:2.0:1789778387.139678:0:14840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778387.139763:0:14840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e945bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789778387.139817:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314937216 00000100:00100000:3.0:1789778387.139823:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314937216 00000100:00100000:3.0:1789778387.139907:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789778387.139917:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14840:x1876718314937216:12345-0@lo:104: 00010000:00010000:3.0:1789778387.139929:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778387.139992:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789778387.139998:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14840:x1876718314937216:12345-0@lo:104: Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778387.140005:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789778387.140051:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778387.140058:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140085:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:0.0:1789778387.140089:0:14396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140098:0:14396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789778387.140106:0:14396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778387.140112:0:14396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789778387.140140:0:14396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140147:0:14396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789778387.140173:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140181:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757e00/0x5a1e1c1157441e05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e0c expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140195:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778387.140197:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778387.140204:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778387.140216:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3313:1876718314937344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789778387.140244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778387.140277:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314937344 00000100:00100000:0.0:1789778387.140281:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314937344 00010000:00010000:0.0:1789778387.140298:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 12 pid: 14401 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778387.140324:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789778387.140331:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:3313:x1876718314937344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789778387.140340:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778387.140345:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 12 pid: 14401 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140355:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 12 pid: 14401 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140369:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140377:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140388:0:14393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140395:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140402:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140419:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140424:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778387.140428:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140435:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140442:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778387.140451:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778387.140490:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:3313:x1876718314937344:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778387.140496:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789778387.140528:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3313:1876718314937344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778387.140623:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441e0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157441e05 expref: 11 pid: 14401 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778387.140633:0:14840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14840:1876718314937216:0@lo:104: 00010000:00010000:2.0:1789778387.140646:0:14840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778387.140654:0:14840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778387.140660:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778387.140666:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e833f9800/0x5a1e1c1157441e4b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778388.145271:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789778388.529197:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789778388.529204:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ec17e1800 from 10 10000000:01000000:0.0:1789778388.529210:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778388.529256:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778388.529338:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778388.529349:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778388.529391:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314937472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789778388.529528:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778388.529690:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e985c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1789778388.529834:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314937472 00000100:00100000:1.0:1789778388.529842:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314937472 00000100:00100000:1.0:1789778388.530045:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789778388.530098:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+11:14405:x1876718314937472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789778388.530113:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778388.530130:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441e52 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778388.530167:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778388.530177:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778388.530184:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320800, rc 0) 00000100:00100000:1.0:1789778388.530233:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314937472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778388.530239:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789778388.530339:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314937472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778388.530361:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778388.530369:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778388.530427:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314937600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778388.530469:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778388.534875:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9fa090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778388.534978:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314937600 00000100:00100000:0.0:1789778388.534987:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314937600 00000100:00100000:0.0:1789778388.535038:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789778388.535047:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314937600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778388.535636:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314937600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (4965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778388.535647:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789778388.539051:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314937600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778388.539573:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314937728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778388.539654:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778388.539750:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9fa090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778388.540378:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314937728 00000100:00100000:0.0:1789778388.540386:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314937728 00000100:00100000:0.0:1789778388.540442:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789778388.540452:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314937728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778388.541111:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:14405:x1876718314937728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 658us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778388.541120:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789778388.541224:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314937728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789778388.542197:0:14902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789778388.542381:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789778388.542402:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789778388.542412:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778388.542424:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778389.172703:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778389.425120:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789778379/real 1789778379] req@ffff9b3d822f1180 x1876718314934400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778389.425587:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3d822f1180 x1876718314934400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778389.425600:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789778379/real 1789778379] req@ffff9b3d822f3100 x1876718314934144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778389 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789778389.425613:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3d822f3100 x1876718314934144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778389 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789778389.425630:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3e88d7f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789778389.425638:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789778389.425651:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314934400:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789778389.425657:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1647000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789778389.425663:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789778389.425665:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314934144:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789778389.426257:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789778389.426262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789778389.426264:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1647000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789778389.426269:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1789778389.426274:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789778389.426280:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b3ec1647000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1789778389.426287:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789778389.426304:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314937856:0@lo:400:kworker.0 00000100:00100000:0.0:1789778389.426361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778389.426416:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314937856 00000100:00100000:0.0:1789778389.427284:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314937856 00000100:00100000:0.0:1789778389.427375:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789778389.427385:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:3311:x1876718314937856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778389.427463:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:3311:x1876718314937856:12345-0@lo:400:kworker.0 Request processed in 80us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778389.427470:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789778389.427591:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314937856:0@lo:400:kworker.0 00000100:00100000:0.0:1789778389.427625:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ec17aad80 x1876718314937984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789778389.427650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789778389.427654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789778389.427657:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b3e88d7f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789778389.427661:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1789778389.427664:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789778389.427668:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3e88d7f000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1789778389.427679:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ec17ab100 x1876718314938112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789778389.427725:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314938240:0@lo:400:kworker.0 00000100:00100000:3.0:1789778389.427757:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778389.427803:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314937984:0@lo:8:kworker.0 00000400:00000100:2.0:1789778389.427843:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876718314937984 offset 0 length 520: 4 00000100:00100000:2.0:1789778389.427863:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314938112:0@lo:8:kworker.0 00000400:00000100:2.0:1789778389.427879:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876718314938112 offset 0 length 520: 4 00000100:00100000:3.0:1789778389.428936:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314938240 00000100:00100000:3.0:1789778389.428944:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314938240 00000100:00100000:3.0:1789778389.428980:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778389.428987:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314938240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778389.429042:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314938240:12345-0@lo:400:kworker.0 Request processed in 56us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778389.429049:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789778389.429102:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3ec17a9c00 x1876718314938240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778389.429115:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314938240:0@lo:400:kworker.0 00010000:00010000:2.0:1789778390.194328:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778391.217325:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789778391.474011:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789778391.601810:0:15091:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789778391.601813:0:15091:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789778391.601909:0:15091:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b3ea019f800 00000020:01000004:1.0:1789778391.601922:0:15091:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789778391.601932:0:15091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789778391.601941:0:15091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b3e91fe3370) 00000020:00000080:1.0:1789778391.601952:0:15091:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789778391.611475:0:15091:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789778391.611761:0:15091:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789778391.613984:0:15091:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789778391.614205:0:15091:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789778391.614371:0:15091:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789778391.615356:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 253: rc = 0 00100000:10000000:1.0:1789778391.615520:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 253: rc = 0 00100000:10000000:1.0:1789778391.615656:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 253: rc = 0 00100000:10000000:1.0:1789778391.616137:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 408: rc = 0 00100000:10000000:1.0:1789778391.616326:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 408: rc = 0 00100000:10000000:1.0:1789778391.616506:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 408: rc = 0 00100000:10000000:1.0:1789778391.617582:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 408: rc = 0 00100000:10000000:1.0:1789778391.617755:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 408: rc = 0 00100000:10000000:1.0:1789778391.617932:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 408: rc = 0 00000020:00000080:1.0:1789778391.618408:0:15091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789778391.618417:0:15091:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789778391.618429:0:15091:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5a1e1c1157441e67 00000020:01000004:1.0:1789778391.618435:0:15091:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789778391.618451:0:15091:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789778391.618454:0:15091:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789778391.618458:0:15091:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789778391.618461:0:15091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789778391.618469:0:15091:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b3e91fe4d28) 00000020:00000080:1.0:1789778391.618476:0:15091:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789778391.619879:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789778391.620488:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789778391.620494:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789778391.625393:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789778391.625405:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789778391.625656:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789778391.625661:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789778391.626887:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778391.627047:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789778391.627052:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789778391.628351:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789778391.628360:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789778391.646022:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789778391.646446:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789778391.646452:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789778391.648262:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789778391.648273:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789778391.649778:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789778391.649791:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789778391.654320:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789778391.654541:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789778391.654547:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789778391.655271:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789778391.655279:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789778391.723285:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789778391.723485:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789778391.723490:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789778391.724719:0:15091:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789778391.724727:0:15091:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789778391.726691:0:15091:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789778391.726719:0:15091:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789778391.726726:0:15091:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789778391.744796:0:15091:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789778391.744834:0:15091:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.145@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789778391.744840:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789778391.744841:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789778391.744842:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778391.744844:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778391.744845:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778391.744846:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778391.744847:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778391.744848:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778391.744850:0:15091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789778391.744853:0:15091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789778391.744856:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789778391.744857:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789778391.744858:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789778391.744859:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789778391.744860:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789778391.744861:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789778391.744862:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789778391.744863:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789778391.744864:0:15091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789778391.744888:0:15091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789778391.744907:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938368:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789778391.744989:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778391.745267:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e985c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778391.745408:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314938368 00000100:00100000:3.0:1789778391.745417:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314938368 00000100:00100000:3.0:1789778391.745640:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789778391.745651:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:15091:x1876718314938368:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789778391.745681:0:14403:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789778391.745684:0:14403:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789778391.745688:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789778391.762403:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:15091:x1876718314938368:12345-0@lo:253:mount.lustre.0 Request processed in 16744us (17404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778391.762417:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789778391.764753:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938368:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789778391.764774:0:15091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789778391.764777:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789778391.764779:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789778391.764780:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778391.764781:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778391.764782:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778391.764783:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778391.764784:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778391.764786:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778391.764787:0:15091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789778391.764811:0:15091:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3ea019f800 from lustre-OST0000 10000000:01000000:2.0:1789778391.764837:0:15091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789778391.764839:0:15091:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789778391.764846:0:15091:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3eb9770000 local copy 00010000:00010000:2.0:1789778391.764856:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778391.765142:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778391.765640:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.765696:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e954c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789778391.765824:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314938496 00000100:00100000:0.0:1789778391.765833:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314938496 00000100:00100000:0.0:1789778391.765886:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789778391.765896:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:15091:x1876718314938496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789778391.766435:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:15091:x1876718314938496:12345-0@lo:501:mount.lustre.0 Request processed in 538us (794us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789778391.766444:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789778391.766602:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938496:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789778391.766622:0:15091:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789778391.766795:0:15091:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789778391.766803:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.766813:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778391.766839:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3ea019f800 10000000:01000000:2.0:1789778391.766844:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789778391.766850:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b3eb9770000 10000000:01000000:2.0:1789778391.766852:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789778391.766855:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b3eb9770000 from 1 10000000:01000000:2.0:1789778391.766857:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789778391.766885:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9200/0x5a1e1c1157441e75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.766892:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9200/0x5a1e1c1157441e75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.766901:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9200/0x5a1e1c1157441e75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778391.766915:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778391.766947:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.766983:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e954c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778391.767636:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314938624 00000100:00100000:3.0:1789778391.767644:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314938624 00000100:00100000:3.0:1789778391.767688:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789778391.767696:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+12:15091:x1876718314938624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778391.767718:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778391.767732:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44de00/0x5a1e1c1157441e7c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441e75 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.767754:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44de00/0x5a1e1c1157441e7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441e75 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.767764:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44de00/0x5a1e1c1157441e7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e75 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.767773:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44de00, rc 0) 00000100:00100000:3.0:1789778391.767816:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+13:15091:x1876718314938624:12345-0@lo:101:mount.lustre.0 Request processed in 121us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778391.767823:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789778391.767858:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778391.767880:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9200/0x5a1e1c1157441e75 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e7c expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.767889:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9200/0x5a1e1c1157441e75 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441e7c expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778391.767907:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789778391.767928:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9200/0x5a1e1c1157441e75 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e7c expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.767936:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f9200/0x5a1e1c1157441e75 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e7c expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778391.767942:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789778391.767946:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778391.767951:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789778391.767953:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789778391.767968:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8000/0x5a1e1c1157441e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.767975:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8000/0x5a1e1c1157441e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.767983:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8000/0x5a1e1c1157441e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778391.767996:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778391.768024:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.768157:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e954c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778391.768259:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314938752 00000100:00100000:3.0:1789778391.768263:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314938752 00000100:00100000:3.0:1789778391.768333:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789778391.768341:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+13:15091:x1876718314938752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778391.768349:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778391.768358:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44d400/0x5a1e1c1157441e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441e83 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.768372:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44d400/0x5a1e1c1157441e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441e83 expref: 14 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.768391:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44d400/0x5a1e1c1157441e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e83 expref: 14 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.768398:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d400, rc 0) 00000100:00100000:3.0:1789778391.768451:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314938752:12345-0@lo:101:mount.lustre.0 Request processed in 111us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778391.768456:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789778391.768596:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778391.768606:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8000/0x5a1e1c1157441e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e8a expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.768614:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8000/0x5a1e1c1157441e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441e8a expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789778391.769274:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789778391.770741:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789778391.770983:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789778391.771028:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789778391.771060:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789778391.771248:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789778391.771286:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789778391.771633:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789778391.771716:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789778391.771725:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789778391.771815:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778391.771882:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.771987:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e954c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778391.772033:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314938880 00000100:00100000:3.0:1789778391.772040:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314938880 00000100:00100000:2.0:1789778391.772294:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789778391.772305:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314938880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778391.773036:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314938880:12345-0@lo:501:mount.lustre.0 Request processed in 731us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778391.773045:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789778391.773163:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314938880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789778391.773206:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789778391.773248:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.773780:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789778391.773832:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939008 00000100:00100000:0.0:1789778391.773838:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939008 00000100:00100000:0.0:1789778391.773930:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789778391.773939:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314939008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789778391.774349:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314939008:12345-0@lo:503:mount.lustre.0 Request processed in 409us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778391.774358:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789778391.774821:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939008:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789778391.776030:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789778391.776298:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789778391.776742:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.776835:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789778391.776883:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939136 00000100:00100000:0.0:1789778391.776891:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939136 00000100:00100000:0.0:1789778391.776976:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789778391.776986:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314939136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778391.777240:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314939136:12345-0@lo:502:mount.lustre.0 Request processed in 253us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778391.777247:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789778391.777341:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789778391.777637:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789778391.777693:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789778391.777731:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789778391.777812:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789778391.777849:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789778391.777880:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789778391.777925:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789778391.777960:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789778391.777992:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789778391.778038:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789778391.778110:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789778391.778159:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789778391.778189:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789778391.778230:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.778852:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789778391.778951:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939264 00000100:00100000:1.0:1789778391.778958:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939264 00000100:00100000:1.0:1789778391.778994:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789778391.779003:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314939264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778391.779307:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314939264:12345-0@lo:502:mount.lustre.0 Request processed in 304us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.779542:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789778391.779676:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789778391.779761:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789778391.779773:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789778391.780813:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789778391.780821:0:15105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789778391.780827:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778391.780829:0:15105:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789778391.780838:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789778391.780858:0:15105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b3e85d019b8) 00000020:00000080:0.0:1789778391.780880:0:15105:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789778391.780886:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789778391.780957:0:15105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ea019f800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789778391.780965:0:15105:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789778391.780972:0:15105:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5a1e1c1157441e98 00010000:00010000:1.0:1789778391.785673:0:15105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789778391.786196:0:15105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789778391.788674:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789778391.790710:0:15105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789778391.790721:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778391.790728:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778391.790730:0:15105:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789778391.790734:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789778391.790736:0:15105:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789778391.790738:0:15105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789778391.790740:0:15105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789778391.790741:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789778391.790744:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778391.790746:0:15105:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789778391.790748:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778391.790751:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778391.790753:0:15105:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789778391.790756:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789778391.790758:0:15105:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789778391.790761:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778391.790763:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778391.790764:0:15105:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789778391.790767:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778391.790776:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778391.790778:0:15105:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789778391.790782:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789778391.790838:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778391.790840:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778391.790842:0:15105:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789778391.790845:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789778391.791000:0:15091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789778391.791026:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789778391.791047:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8000/0x5a1e1c1157441e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e8a expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.791058:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8000/0x5a1e1c1157441e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441e8a expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778391.791127:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ea019f800 from 1 10000000:01000000:2.0:1789778391.791136:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789778391.791172:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.791180:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.791191:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778391.791214:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778391.791276:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.791328:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789778391.791408:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939392 00000100:00100000:3.0:1789778391.791415:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939392 00000100:00100000:3.0:1789778391.791629:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789778391.791639:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+14:15091:x1876718314939392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778391.791652:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778391.791665:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441e9f expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.791689:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 15 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.791699:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 15 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.791706:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44d800, rc 0) 00000100:00100000:3.0:1789778391.791745:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939392:12345-0@lo:101:mount.lustre.0 Request processed in 107us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778391.791752:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789778391.791886:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778391.791900:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.791908:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789778391.792714:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789778391.793204:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789778391.794902:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789778391.794976:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789778391.795097:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789778391.795106:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789778391.795196:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778391.795265:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.795319:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789778391.796437:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939520 00000100:00100000:0.0:1789778391.796447:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939520 00000100:00100000:0.0:1789778391.796665:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789778391.796676:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789778391.796938:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939520:12345-0@lo:501:mount.lustre.0 Request processed in 264us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778391.796946:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789778391.797694:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778391.797755:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778391.797806:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.798416:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789778391.806897:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939648 00000100:00100000:2.0:1789778391.806910:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939648 00000100:00100000:2.0:1789778391.807611:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789778391.807624:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939648:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778391.807853:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939648:12345-0@lo:503:mount.lustre.0 Request processed in 231us (10046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778391.807860:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789778391.809822:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789778391.810738:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789778391.810817:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789778391.810897:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.810986:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88da2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789778391.811030:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939776 00000100:00100000:3.0:1789778391.811036:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939776 00000100:00100000:2.0:1789778391.811341:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789778391.811352:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789778391.811753:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939776:12345-0@lo:502:mount.lustre.0 Request processed in 401us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778391.811762:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789778391.811847:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789778391.812139:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789778391.812198:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789778391.812258:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789778391.812295:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789778391.812342:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789778391.812391:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789778391.812441:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789778391.812473:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789778391.812578:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789778391.812625:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.812952:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789778391.813030:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314939904 00000100:00100000:0.0:1789778391.813037:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314939904 00000100:00100000:1.0:1789778391.813691:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789778391.813711:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778391.813922:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314939904:12345-0@lo:502:mount.lustre.0 Request processed in 214us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.813930:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789778391.814019:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314939904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789778391.814194:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789778391.814207:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789778391.815615:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778391.815626:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778391.815628:0:15109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789778391.815636:0:15109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ea019f800 00000020:00000080:0.0:1789778391.815639:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789778391.815646:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778391.815648:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778391.815649:0:15109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789778391.815652:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778391.815654:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778391.815656:0:15109:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789778391.815658:0:15109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3ea019f800 00000020:00000080:0.0:1789778391.815660:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789778391.815718:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778391.815722:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778391.815723:0:15109:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789778391.815725:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789778391.815727:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778391.815728:0:15109:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789778391.815732:0:15109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3ea019f800 00000020:00000080:0.0:1789778391.815733:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789778391.815766:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778391.815770:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778391.815777:0:15109:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789778391.815780:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789778391.815917:0:15091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789778391.815939:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789778391.815959:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.815970:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789778391.816008:0:15091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789778391.816011:0:15091:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3ea019f800 10000000:01000000:3.0:1789778391.816014:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3ea019f800 10000000:01000000:3.0:1789778391.816018:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789778391.816024:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3ea019f800 from 1 10000000:01000000:3.0:1789778391.816027:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789778391.816060:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ebf44d200/0x5a1e1c1157441ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.816098:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3ebf44d200/0x5a1e1c1157441ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.816115:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3ebf44d200/0x5a1e1c1157441ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778391.816137:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789778391.816200:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.816233:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778391.816578:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940032 00000100:00100000:1.0:1789778391.816585:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940032 00000100:00100000:1.0:1789778391.816631:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789778391.816640:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314940032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789778391.816652:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778391.816665:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d82320000/0x5a1e1c1157441eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441ead expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778391.816688:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d82320000/0x5a1e1c1157441eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441ead expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778391.816698:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d82320000/0x5a1e1c1157441eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441ead expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778391.816706:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320000, rc 0) 00000100:00100000:1.0:1789778391.816756:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940032:12345-0@lo:101:mount.lustre.0 Request processed in 117us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.816763:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789778391.817692:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778391.817709:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3ebf44d200/0x5a1e1c1157441ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441eb4 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.817719:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3ebf44d200/0x5a1e1c1157441ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441eb4 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789778391.818710:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789778391.819179:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789778391.820946:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789778391.821014:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789778391.821050:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789778391.821856:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789778391.821891:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789778391.821932:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789778391.821961:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789778391.821989:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789778391.822035:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789778391.822110:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789778391.822144:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789778391.822184:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789778391.822215:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789778391.822241:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789778391.822301:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789778391.822345:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789778391.822372:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789778391.822429:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789778391.822459:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789778391.822515:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789778391.822556:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789778391.822584:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789778391.822609:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789778391.822645:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789778391.822671:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789778391.822697:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789778391.822733:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789778391.822759:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789778391.822828:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789778391.822835:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789778391.822931:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789778391.822999:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.823044:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778391.824363:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940160 00000100:00100000:2.0:1789778391.824373:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940160 00000100:00100000:2.0:1789778391.824431:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789778391.824441:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778391.824832:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940160:12345-0@lo:501:mount.lustre.0 Request processed in 391us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778391.824845:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789778391.827476:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789778391.827691:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789778391.827756:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.827800:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778391.827907:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940288 00000100:00100000:1.0:1789778391.827915:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940288 00000100:00100000:1.0:1789778391.827964:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789778391.827973:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789778391.828199:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940288:12345-0@lo:503:mount.lustre.0 Request processed in 226us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.828216:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789778391.829658:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789778391.830660:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789778391.830743:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789778391.830821:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.830871:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778391.831001:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940416 00000100:00100000:1.0:1789778391.831009:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940416 00000100:00100000:1.0:1789778391.831049:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789778391.831059:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778391.831300:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940416:12345-0@lo:502:mount.lustre.0 Request processed in 242us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.831308:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789778391.832591:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789778391.832886:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789778391.832944:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789778391.832978:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789778391.833041:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789778391.833118:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789778391.833169:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789778391.833204:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789778391.833235:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789778391.833280:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789778391.834665:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789778391.834734:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789778391.834794:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789778391.834832:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789778391.834866:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789778391.834912:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789778391.834946:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789778391.834977:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789778391.835022:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789778391.835053:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789778391.835140:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789778391.835190:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789778391.835227:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789778391.835261:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789778391.835322:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789778391.835355:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789778391.835384:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789778391.839484:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789778391.839593:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789778391.839629:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789778391.839709:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789778391.839748:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789778391.839793:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789778391.839825:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789778391.839871:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789778391.839906:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789778391.839971:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789778391.840006:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789778391.840035:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789778391.840109:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789778391.840146:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789778391.840194:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789778391.840272:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.840336:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789778391.840637:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940544 00000100:00100000:1.0:1789778391.840644:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940544 00000100:00100000:1.0:1789778391.840704:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789778391.840713:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778391.840938:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940544:12345-0@lo:502:mount.lustre.0 Request processed in 225us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.840945:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789778391.842590:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789778391.842716:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789778391.842731:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789778391.852883:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789778391.852901:0:15113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b3e85d00000) 00000020:00000080:0.0:1789778391.852921:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789778391.852993:0:15113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3ea019f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789778391.852998:0:15113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3ea019f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789778391.853000:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3ea019f800 3 00010000:00080000:0.0:1789778391.853028:0:15113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3e84ef3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1789778391.855649:0:15113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789778391.855836:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789778391.855871:0:15113:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789778391.855883:0:15113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5a1e1c1157441ec2 00000100:00080000:0.0:1789778391.855894:0:15113:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789778391.855899:0:15113:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3e84ef3000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1789778391.855947:0:15113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ec17aa680 x1876718314940672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789778391.856026:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876718314940672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789778391.856118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789778391.856247:0:15113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789778391.857272:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789778391.857279:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789778391.857282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789778391.857285:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789778391.857355:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314940800:0@lo:400:kworker.0 00000100:00100000:2.0:1789778391.857411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.857472:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940672 00000100:00100000:2.0:1789778391.857479:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940672 00000100:00100000:2.0:1789778391.857504:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940800 00000100:00100000:2.0:1789778391.857507:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940800 00000100:00100000:2.0:1789778391.857530:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778391.857538:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314940800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778391.857588:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314940800:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778391.857595:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778391.857611:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789778391.857616:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876718314940672:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789778391.857634:0:14408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1789778391.857667:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5a1e1c1157441ec9 00000004:00100000:2.0:1789778391.857680:0:14408:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789778391.857708:0:14408:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7dd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778391.862452:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876718314940672:12345-0@lo:38:llog_process_th.0 Request processed in 4824us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778391.862478:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789778391.862549:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3eb94b2680 x1876718314940800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778391.862564:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314940800:0@lo:400:kworker.0 00010000:00080000:3.0:1789778391.866561:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3ec17aa680 x1876718314940672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789778401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778391.866575:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789778391.866585:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789778391.866595:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789778391.866600:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789778391.866603:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3e84ef3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789778391.866609:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876718314940672:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789778391.867950:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789778391.870525:0:15091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789778391.870559:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789778391.870580:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3ebf44d200/0x5a1e1c1157441ead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441eb4 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.870591:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3ebf44d200/0x5a1e1c1157441ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441eb4 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789778391.870665:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789778391.870668:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789778391.870669:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789778391.870670:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789778391.870671:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789778391.870673:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789778391.870674:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789778391.870676:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789778391.870677:0:15091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789778391.870681:0:15091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789778391.870684:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789778391.870685:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789778391.870686:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789778391.870687:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789778391.870688:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789778391.870689:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789778391.870690:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789778391.870691:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789778391.870692:0:15091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789778391.870717:0:15091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789778391.870736:0:15091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789778391.870801:0:15091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778391.870839:0:15091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e869f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789778391.872544:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314940928 00000100:00100000:1.0:1789778391.872555:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314940928 00000100:00100000:1.0:1789778391.872603:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789778391.872613:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15091:x1876718314940928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789778391.872643:0:14401:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789778391.872656:0:14401:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789778391.902556:0:14401:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789778391.902575:0:14401:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789778391.902621:0:14423:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789778391.902626:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789778391.902648:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.902666:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.902674:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.902715:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.902730:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 16 pid: 14403 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778391.902744:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14423:1876718314941056:0@lo:104: 00000100:00100000:2.0:1789778391.902810:0:14423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.902854:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778391.903157:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941056 00000100:00100000:1.0:1789778391.903166:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941056 00000100:00100000:1.0:1789778391.903215:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778391.903224:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14423:x1876718314941056:12345-0@lo:104: 00010000:00010000:1.0:1789778391.903250:0:14391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778391.903298:0:14391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789778391.903304:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14423:x1876718314941056:12345-0@lo:104: Request processed in 82us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.903321:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789778391.903491:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778391.903498:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.903506:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778391.903516:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.903524:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778391.903531:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778391.903536:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789778391.903600:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.903607:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778391.903626:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.903633:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8a00/0x5a1e1c1157441e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e3d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778391.903648:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778391.903650:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778391.903652:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778391.903664:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3313:1876718314941184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778391.903694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778391.903747:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14423:1876718314941056:0@lo:104: 00010000:00010000:2.0:1789778391.903766:0:14423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778391.904742:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941184 00000100:00100000:3.0:1789778391.904753:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941184 00010000:00010000:3.0:1789778391.904781:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 17 pid: 14403 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778391.904815:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789778391.904834:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:3313:x1876718314941184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789778391.904845:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778391.904850:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 17 pid: 14403 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904860:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 17 pid: 14403 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904875:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95757400/0x5a1e1c1157441e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157441e36 expref: 17 pid: 14403 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904889:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904896:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789778391.904911:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002285421s 00010000:00010000:3.0:1789778391.904915:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904922:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904928:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904934:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904939:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778391.904951:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904958:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904974:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.904986:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778391.905038:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:3313:x1876718314941184:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778391.905044:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789778391.905108:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3313:1876718314941184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789778391.905129:0:14423:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.905136:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778391.905141:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e833f8c00/0x5a1e1c1157441ed0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778391.922626:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:15091:x1876718314940928:12345-0@lo:253:mount.lustre.0 Request processed in 50005us (51815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778391.922641:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789778391.922765:0:15091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15091:1876718314940928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789778391.922782:0:15091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789778391.922786:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789778391.922787:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789778391.922788:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789778391.922790:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789778391.922791:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789778391.922792:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789778391.922811:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789778391.922813:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789778391.922814:0:15091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789778391.922833:0:15091:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789778391.928935:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778391.929240:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789778391.929989:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778391.930171:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789778391.930302:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778391.930575:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789778391.931301:0:15091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789778391.966875:0:15091:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789778391.966884:0:15091:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789778391.966919:0:15091:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789778391.966979:0:15091:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789778391.966994:0:15091:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789778391.967022:0:15091:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789778392.241294:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778393.266305:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789778393.910280:0:14405:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789778393.910287:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3ec17e1800 from 7 10000000:01000000:0.0:1789778393.910292:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789778393.910334:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778393.910346:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778393.910356:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778393.910406:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314941312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789778393.910475:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778393.910515:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09780 going to sleep for 11 seconds 00000100:00100000:3.0:1789778393.911232:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941312 00000100:00100000:3.0:1789778393.911242:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941312 00000100:00100000:3.0:1789778393.911296:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789778393.911305:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+15:14405:x1876718314941312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778393.911318:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778393.911333:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441ed7 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778393.911355:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 16 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778393.911365:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 16 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778393.911373:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3ebf44da00, rc 0) 00000100:00100000:3.0:1789778393.911433:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:14405:x1876718314941312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778393.911440:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789778393.911644:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314941312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778393.911661:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778393.911671:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778393.911726:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314941440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789778393.911763:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778393.911788:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09780 going to sleep for 11 seconds 00000100:00100000:1.0:1789778393.912109:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941440 00000100:00100000:1.0:1789778393.912115:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941440 00000100:00100000:1.0:1789778393.912149:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789778393.912157:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:14405:x1876718314941440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789778393.912170:0:14401:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789778393.912187:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789778393.912190:0:14401:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789778393.912271:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:14405:x1876718314941440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778393.912278:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789778393.912601:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314941440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789778393.912659:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789778393.912667:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778393.912675:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778394.297144:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778395.313275:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778396.337567:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789778397.121865:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789778397.121871:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789778397.122441:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789778397.122446:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789778397.124128:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314941824:0@lo:400:kworker.0 00000100:00100000:0.0:1789778397.124209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778397.124298:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314941696:0@lo:400:kworker.0 00000100:00100000:0.0:1789778397.124335:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778397.124355:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789778397.124361:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314941568:0@lo:400:kworker.0 00000100:00100000:0.0:1789778397.124383:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778397.124618:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941824 00000100:00100000:1.0:1789778397.124628:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941824 00000100:00100000:1.0:1789778397.124683:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941696 00000100:00100000:1.0:1789778397.124687:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941696 00000100:00100000:1.0:1789778397.124704:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778397.124712:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314941824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778397.124767:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314941824:12345-0@lo:400:kworker.0 Request processed in 55us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778397.124782:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789778397.124800:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778397.124806:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314941696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778397.124837:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314941696:12345-0@lo:400:kworker.0 Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778397.124843:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778397.124862:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941568 00000100:00100000:1.0:1789778397.124865:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941568 00000100:00100000:1.0:1789778397.124890:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789778397.124896:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:3311:x1876718314941568:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789778397.125040:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789778397.125196:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb94b1500 x1876718314941696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778397.125210:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314941696:0@lo:400:kworker.0 00010000:00080000:0.0:1789778397.125239:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3eb94b3100 x1876718314941824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778397.125248:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314941824:0@lo:400:kworker.0 00000100:00100000:1.0:1789778397.125454:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:3311:x1876718314941568:12345-0@lo:400:kworker.0 Request processed in 558us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778397.125461:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789778397.125523:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314941568:0@lo:400:kworker.0 00000001:02000400:0.0:1789778397.135634:0:15457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789778397.362192:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778398.385548:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778399.411496:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778400.435277:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778401.458402:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789778401.718912:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1789778402.229729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789778402.229736:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789778402.229739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789778402.229742:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789778402.229761:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778402.229785:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314941952:0@lo:400:kworker.0 00000100:00100000:0.0:1789778402.229857:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778402.229917:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314941952 00000100:00100000:3.0:1789778402.229931:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314941952 00000100:00100000:0.0:1789778402.229937:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314942080:0@lo:400:kworker.0 00000100:00100000:0.0:1789778402.229971:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778402.229983:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789778402.229994:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:3312:x1876718314941952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778402.229997:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778402.230005:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314942208:0@lo:400:kworker.0 00000100:00100000:0.0:1789778402.230033:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778402.230087:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:3312:x1876718314941952:12345-0@lo:400:kworker.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778402.230091:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942080 00000100:00100000:3.0:1789778402.230096:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789778402.230102:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942080 00000100:00100000:0.0:1789778402.230134:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942208 00000100:00100000:0.0:1789778402.230138:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942208 00000100:00100000:0.0:1789778402.230175:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789778402.230183:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314942080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789778402.230197:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778402.230235:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876718314942080:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778402.230241:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789778402.230255:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789778402.230263:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314942208:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789778402.230287:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3ebfbee680 x1876718314942080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778402.230296:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314942208:12345-0@lo:400:kworker.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778402.230306:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789778402.230308:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876718314942080:0@lo:400:kworker.0 00010000:00080000:3.0:1789778402.230334:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3ebfbeca80 x1876718314942208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778402.230343:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314942208:0@lo:400:kworker.0 00000100:00100000:0.0:1789778402.230511:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314941952:0@lo:400:kworker.0 00010000:00010000:0.0:1789778402.501123:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778403.515628:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778404.145156:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789778389/real 1789778389] req@ffff9b3ec17aad80 x1876718314937984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778404 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778404.145256:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3ec17aad80 x1876718314937984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778404 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778404.145266:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789778389/real 1789778389] req@ffff9b3ec17ab100 x1876718314938112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778404 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778404.145276:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3ec17ab100 x1876718314938112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789778404 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789778404.145294:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1647000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789778404.145492:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789778404.145496:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314937984:0@lo:8:kworker.0 00000100:00080000:3.0:1789778404.145522:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3e88d7f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1789778404.156657:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314942336:0@lo:400:kworker.0 00000100:00100000:2.0:1789778404.156743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789778404.157551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789778404.157558:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789778404.157561:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1647000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789778404.157566:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1789778404.157572:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789778404.157580:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b3ec1647000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1789778404.157606:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3d822f1180 x1876718314942464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789778404.157620:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789778404.157623:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789778404.157625:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b3e88d7f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789778404.157643:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1789778404.157646:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789778404.157650:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3e88d7f000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:1.0:1789778404.157663:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3d822f0380 x1876718314942592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789778404.157773:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789778404.157779:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314938112:0@lo:8:kworker.0 00000100:00100000:3.0:1789778404.157986:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942336 00000100:00100000:3.0:1789778404.157995:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942336 00000100:00100000:3.0:1789778404.158039:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789778404.158048:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:3312:x1876718314942336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778404.158278:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314942720:0@lo:400:kworker.0 00000100:00100000:0.0:1789778404.158313:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.158348:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942720 00000100:00100000:0.0:1789778404.158353:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942720 00000100:00100000:0.0:1789778404.158381:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789778404.158388:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314942720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778404.158426:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876718314942720:12345-0@lo:400:kworker.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.158434:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789778404.158471:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3d822f2a00 x1876718314942720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778404.158498:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876718314942720:0@lo:400:kworker.0 00000100:00100000:0.0:1789778404.158518:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314942464:0@lo:8:kworker.0 00000100:00100000:0.0:1789778404.158548:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.158575:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314942592:0@lo:8:kworker.0 00000100:00100000:0.0:1789778404.158598:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.170658:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314942848:0@lo:400:kworker.0 00000100:00100000:0.0:1789778404.170763:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778404.170924:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942848 00000100:00100000:1.0:1789778404.170932:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942848 00000100:00100000:1.0:1789778404.170991:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789778404.171001:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314942848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778404.172051:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:3312:x1876718314942336:12345-0@lo:400:kworker.0 Request processed in 14000us (15302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.172061:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789778404.172125:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942464 00000100:00100000:3.0:1789778404.172131:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942464 00000100:00100000:3.0:1789778404.172145:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942592 00000100:00100000:3.0:1789778404.172147:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942592 00000100:00100000:3.0:1789778404.172158:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778404.172173:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876718314942464:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789778404.172196:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1789778404.172224:0:15093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157441ee5 00002000:00100000:3.0:1789778404.172236:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b3eabbad000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789778404.172240:0:15093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789778404.172242:0:15093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789778404.172535:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789778404.172556:0:15093:0:(import.c:65:import_set_state_nolock()) ffff9b3eabbad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789778404.172603:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876718314942464:12345-0@lo:8:kworker.0 Request processed in 429us (14054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.172610:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778404.172635:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789778404.172639:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876718314942592:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789778404.172649:0:15093:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789778404.172672:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876718314942592:12345-0@lo:8:kworker.0 Request processed in 32us (14073us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789778404.172678:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789778404.172715:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3d822f1180 x1876718314942464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789778424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778404.172736:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789778404.172743:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789778404.174583:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789778404.174589:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789778404.174593:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ec1647000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789778404.174614:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789778404.174623:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314942464:0@lo:8:kworker.0 00000100:00080000:3.0:1789778404.174652:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3e88d7f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789778404.174656:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789778404.174659:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314942592:0@lo:8:kworker.0 00000100:00100000:2.0:1789778404.175202:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314942336:0@lo:400:kworker.0 00000100:00100000:1.0:1789778404.184078:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876718314942848:12345-0@lo:400:kworker.0 Request processed in 13055us (13291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778404.184094:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789778404.184146:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789778404.184620:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3d822f0e00 x1876718314942848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778404.184636:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876718314942848:0@lo:400:kworker.0 00000100:00100000:0.0:1789778404.184659:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789778404.184671:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314942976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778404.184740:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789778404.188318:0:14429:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789778404.188810:0:14429:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459146743575ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789778404.189817:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314942976 00000100:00100000:3.0:1789778404.192141:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314942976 00000100:00100000:3.0:1789778404.192231:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789778404.192242:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314942976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789778404.192280:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778404.192380:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876718314942976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (7639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.192387:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789778404.192453:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3ebfbeca80 x1876718314942976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789778404.192474:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314942976:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789778404.192501:0:14430:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789778404.192532:0:14430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14430:1876718314943104:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789778404.192568:0:14430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778404.192595:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314943104 00000100:00100000:3.0:1789778404.192599:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314943104 00000100:00100000:3.0:1789778404.192626:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789778404.192632:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14430:x1876718314943104:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1789778404.196658:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789778404.202033:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789778404.202044:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789778404.202050:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:2.0:1789778404.207274:0:14430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e839580c0 going to sleep for 11 seconds 00002000:00010000:3.0:1789778404.223676:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.223688:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.223705:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.223710:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.223716:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.223733:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.223761:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.223777:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.223796:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789778404.225988:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.225999:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226014:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.226018:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.226024:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226037:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226046:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226054:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226103:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789778404.226550:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.226556:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226571:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.226574:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.226579:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226589:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226598:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226605:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.226614:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789778404.230624:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.230636:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.230653:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.230657:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.230663:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.230678:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.230703:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.230711:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.230723:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789778404.236529:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789778404.236541:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236554:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.236559:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236570:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236593:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236613:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000567317fb/0x5a1e1c1157441eec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236635:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789778404.236639:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236644:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44cc00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.236647:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236654:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236664:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236670:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000911f59bc/0x5a1e1c1157441ef3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236681:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778404.236684:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236691:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.236700:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236708:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236718:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236725:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097c71784/0x5a1e1c1157441efa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.236738:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778404.236741:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789778404.238196:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.238206:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.238219:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.238223:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.238229:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.238240:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.238249:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.238256:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.238281:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789778404.239031:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.239037:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.239047:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.239050:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.239054:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.239088:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.239097:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.239104:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.239113:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789778404.239442:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.239447:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239457:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239472:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239481:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb8bc38/0x5a1e1c1157441f01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239507:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778404.239511:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239518:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44ca00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.239521:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239528:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239539:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239546:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1e851e0/0x5a1e1c1157441f08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239557:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778404.239561:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239568:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d000 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.239572:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239592:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239602:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239610:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000508c104/0x5a1e1c1157441f0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.239623:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.239625:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.239627:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.239638:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.245688:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.245702:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245718:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.245728:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.245735:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245761:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245771:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245778:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245800:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778404.245816:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.245822:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245829:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44d600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.245834:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245841:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245856:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245884:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6fd4321/0x5a1e1c1157441f16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.245901:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.245903:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.245905:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.247008:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.247017:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.247029:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.247033:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.247039:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.247049:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.247059:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.247098:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.247116:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778404.247126:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.247137:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.247145:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3ebf44c000 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.247149:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.248889:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.248916:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.248924:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba318966/0x5a1e1c1157441f1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.248945:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.248947:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.248950:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.256982:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.256995:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257011:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.257016:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.257021:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257046:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257055:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257062:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257113:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778404.257126:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.257131:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257140:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.257144:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257152:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257169:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257177:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d3230d9/0x5a1e1c1157441f24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.257202:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.257204:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.257206:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.258553:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.258563:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.258576:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.258579:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.258584:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.258594:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.258603:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.258610:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.258632:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778404.259000:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778404.259014:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.259023:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150e200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778404.259027:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.259037:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.259053:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.259061:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3b084e0/0x5a1e1c1157441f2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.259102:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778404.259104:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778404.259106:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.261709:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.261719:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.262896:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.262903:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.262911:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.262928:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.262938:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.262946:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.262974:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778404.264873:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778404.264885:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.264897:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150fa00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778404.264902:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.264926:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.264945:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.264953:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f742b80/0x5a1e1c1157441f32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.264975:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778404.264978:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778404.264979:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.267013:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.267025:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.267039:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.267043:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.267049:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.267060:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273151:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273161:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273197:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789778404.273803:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.273811:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273835:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.273839:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.273846:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273870:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273879:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273886:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.273915:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789778404.274120:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789778404.274127:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274135:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150ea00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.274140:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274149:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274165:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274172:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000942c507f/0x5a1e1c1157441f39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274190:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.274193:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274200:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150e000 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.274203:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274223:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274233:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274240:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a744bc9/0x5a1e1c1157441f40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274253:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.274254:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.274256:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.274506:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.274513:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274521:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.274525:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.274529:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274538:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274546:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274559:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274573:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778404.274581:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.274584:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274591:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150e400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.274594:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274602:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274614:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274621:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041060c84/0x5a1e1c1157441f47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.274634:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.274636:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.274637:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.275089:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.275104:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275114:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.275118:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.275122:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275132:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275141:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275149:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275163:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778404.275171:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.275175:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275182:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150fc00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.275186:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275194:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275224:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275232:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a86bbaf/0x5a1e1c1157441f4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275248:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.275250:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.275252:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.275687:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.275693:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275701:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.275704:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.275708:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275718:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275726:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275732:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275757:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778404.275765:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.275769:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275776:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.275779:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275786:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275796:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275804:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ec01bd0/0x5a1e1c1157441f55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.275817:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.275819:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.275820:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789778404.276280:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789778404.276286:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.277224:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789778404.279539:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789778404.284550:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1789778404.284572:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778404.284581:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.284601:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.284613:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.284621:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.284668:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778404.286948:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778404.286961:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.286974:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150ee00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778404.286979:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.286990:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.287009:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.287031:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6e0a5eb/0x5a1e1c1157441f5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.287055:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.287058:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.287060:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778404.288167:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.288181:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.288197:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.288203:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.288210:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.288223:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.288233:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.288248:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.288717:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789778404.289875:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.289886:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.290350:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.290355:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.290360:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.290374:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.290383:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.290391:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.290410:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789778404.291489:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789778404.291499:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291510:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.291515:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291525:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291553:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291560:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da1f9856/0x5a1e1c1157441f63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291580:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778404.291583:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291590:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.291593:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291600:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291610:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291616:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c3955cd/0x5a1e1c1157441f6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.291627:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.291629:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.291636:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778404.292257:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778404.292812:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.292820:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.292834:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.292837:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.292841:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.292853:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.292874:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.292882:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.293010:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789778404.293373:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.293377:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.293383:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.293385:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.293388:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.293394:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.293406:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.293410:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298303:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789778404.298316:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298331:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.298335:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298345:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298363:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298368:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000877f3bf4/0x5a1e1c1157441f71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298388:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778404.298391:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298394:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.298396:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298401:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298422:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.298427:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.298428:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.298430:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778404.299970:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789778404.299982:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f375243/0x5a1e1c1157441f78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778404.301449:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.301457:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.301470:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.301473:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.301477:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.301488:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.301525:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778404.301712:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.301733:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.301757:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789778404.302483:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778404.302492:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.302503:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.302509:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.302519:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.302537:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.302545:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097631c31/0x5a1e1c1157441f7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.302562:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.302564:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.302566:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778404.303350:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.303358:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303368:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.303371:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.303375:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303383:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303389:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303393:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303412:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789778404.303812:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.303816:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303827:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.303829:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.303832:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303839:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303846:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303854:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.303878:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789778404.304385:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789778404.304393:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304403:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.304407:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304415:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304429:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304436:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca0a9469/0x5a1e1c1157441f86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304453:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778404.304456:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304462:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f9800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.304465:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304474:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304498:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304506:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a25e672d/0x5a1e1c1157441f8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.304525:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.304527:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.304530:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.304536:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778404.304989:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.304994:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305002:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.305004:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.305008:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305014:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305028:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305033:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305126:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789778404.305133:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789778404.305140:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.305148:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778404.305152:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.305174:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.305189:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.305197:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e8abf0d/0x5a1e1c1157441f94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.305226:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.305230:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778404.305233:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778404.305461:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.305465:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305471:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.305473:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.305475:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305481:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.305486:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.306139:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.306163:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789778404.306177:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778404.306184:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306193:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.306197:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306207:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306233:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306240:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000178a21a9/0x5a1e1c1157441f9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306258:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.306260:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.306262:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778404.306521:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.306527:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.306537:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.306540:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.306544:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.306554:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.306562:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.306568:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.306590:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789778404.306933:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778404.306939:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306947:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.306951:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306960:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306973:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.306980:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5085f69/0x5a1e1c1157441fa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.307012:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.307015:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.307017:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778404.307117:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778404.307122:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.307128:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1789778404.307134:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778404.307137:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.307144:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.307149:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.307153:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.307168:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789778404.307552:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:1.0:1789778404.307704:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778404.307709:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.307715:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778404.307718:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.307723:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.307732:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.307737:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ade700d/0x5a1e1c1157441fa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.307748:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.307749:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.307750:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778404.307788:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14430:x1876718314943104:12345-0@lo:5:osp-pre-0-0.0 Request processed in 115152us (115216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778404.307798:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789778404.307881:0:14430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14430:1876718314943104:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789778404.307897:0:14430:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789778404.307942:0:14430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14430:1876718314943232:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789778404.307978:0:14430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778404.308028:0:14430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e83979840 going to sleep for 11 seconds 00000100:00100000:2.0:1789778404.308196:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314943232 00000100:00100000:2.0:1789778404.308202:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314943232 00000100:00100000:2.0:1789778404.308236:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789778404.308243:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14430:x1876718314943232:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789778404.308280:0:15095:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789778404.319618:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14430:x1876718314943232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11367us (11632us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789778404.319649:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789778404.320123:0:14430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14430:1876718314943232:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789778404.320142:0:14430:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:01000004:3.0:1789778404.400264:0:15808:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789778404.400269:0:15808:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789778404.400410:0:15808:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b3eabbab000 00000020:01000004:3.0:1789778404.400426:0:15808:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789778404.400440:0:15808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789778404.400453:0:15808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b3eb70099b8) 00000020:00000080:3.0:1789778404.400474:0:15808:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789778404.430514:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789778404.430755:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789778404.432180:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789778404.432413:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789778404.432629:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789778404.433445:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 561: rc = 0 00100000:10000000:2.0:1789778404.433543:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 561: rc = 0 00100000:10000000:2.0:1789778404.433637:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 561: rc = 0 00100000:10000000:2.0:1789778404.434426:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 121: rc = 0 00100000:10000000:2.0:1789778404.434776:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 121: rc = 0 00100000:10000000:3.0:1789778404.435638:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 121: rc = 0 00100000:10000000:3.0:1789778404.436350:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 121: rc = 0 00100000:10000000:3.0:1789778404.436629:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 121: rc = 0 00100000:10000000:3.0:1789778404.437640:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 121: rc = 0 00000020:00000080:3.0:1789778404.438736:0:15808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789778404.439751:0:15808:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789778404.439765:0:15808:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5a1e1c1157441fb7 00000020:01000004:3.0:1789778404.439774:0:15808:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789778404.439797:0:15808:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789778404.439800:0:15808:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789778404.439806:0:15808:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789778404.439830:0:15808:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789778404.439834:0:15808:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789778404.470385:0:15808:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789778404.470454:0:15808:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.145@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789778404.470459:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789778404.470461:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778404.470462:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778404.470464:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778404.470465:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778404.470466:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778404.470467:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778404.470468:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778404.470470:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789778404.470474:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789778404.470476:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789778404.470477:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778404.470478:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778404.470479:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778404.470480:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778404.470481:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778404.470482:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778404.470483:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778404.470484:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789778404.470531:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789778404.470552:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789778404.472729:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778404.472875:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17b2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789778404.474272:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314943360 00000100:00100000:1.0:1789778404.474283:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314943360 00000100:00100000:1.0:1789778404.474344:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789778404.474366:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15808:x1876718314943360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789778404.474403:0:14403:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789778404.474406:0:14403:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789778404.474410:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789778404.501660:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15808:x1876718314943360:12345-0@lo:253:mount.lustre.0 Request processed in 27289us (28928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.501676:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789778404.502105:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789778404.502121:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789778404.502124:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789778404.502126:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778404.502127:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778404.502128:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778404.502130:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778404.502131:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778404.502132:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778404.502134:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778404.502135:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789778404.502208:0:15808:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3eabbab000 from lustre-OST0001 10000000:01000000:2.0:1789778404.502231:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789778404.502233:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789778404.502239:0:15808:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3eb9770000 local copy 00010000:00010000:2.0:1789778404.502254:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778404.502442:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778404.502471:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778404.502500:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778404.502653:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314943488 00000100:00100000:3.0:1789778404.502658:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314943488 00000100:00100000:3.0:1789778404.502693:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789778404.502700:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15808:x1876718314943488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789778404.502960:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15808:x1876718314943488:12345-0@lo:501:mount.lustre.0 Request processed in 258us (486us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789778404.502967:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789778404.504306:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943488:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789778404.504324:0:15808:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789778404.504475:0:15808:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789778404.504483:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.504499:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8e00/0x5a1e1c1157441d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441d64 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778404.504653:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3eabbab000 10000000:01000000:2.0:1789778404.504658:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789778404.504662:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789778404.504664:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789778404.504667:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789778404.504669:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789778404.504692:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657200/0x5a1e1c1157441fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.504698:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e81657200/0x5a1e1c1157441fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.504706:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e81657200/0x5a1e1c1157441fbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778404.504716:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778404.504748:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778404.504778:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778404.506489:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314943616 00000100:00100000:3.0:1789778404.506507:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314943616 00000100:00100000:3.0:1789778404.507469:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789778404.507483:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:15808:x1876718314943616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789778404.507512:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778404.507532:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150ee00/0x5a1e1c1157441fc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441fbe expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.507730:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150ee00/0x5a1e1c1157441fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441fbe expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.507991:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150ee00/0x5a1e1c1157441fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441fbe expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.508001:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150ee00, rc 0) 00000100:00100000:3.0:1789778404.508999:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314943616:12345-0@lo:101:mount.lustre.0 Request processed in 1514us (4242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.509009:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789778404.509119:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778404.509138:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e81657200/0x5a1e1c1157441fbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fc5 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.509149:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657200/0x5a1e1c1157441fbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441fc5 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789778404.511911:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789778404.518735:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789778404.519012:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789778404.519060:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789778404.519125:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789778404.520001:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789778404.520049:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789778404.520840:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789778404.520948:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789778404.520956:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789778404.521800:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789778404.521883:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778404.522000:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789778404.524236:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314943744 00000100:00100000:2.0:1789778404.524618:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314943744 00000100:00100000:2.0:1789778404.524737:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789778404.524760:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314943744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778404.526651:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314943744:12345-0@lo:501:mount.lustre.0 Request processed in 1887us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778404.526663:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789778404.533819:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789778404.533989:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789778404.534100:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778404.534133:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789778404.534333:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314943872 00000100:00100000:3.0:1789778404.534341:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314943872 00000100:00100000:3.0:1789778404.534394:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789778404.534403:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314943872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789778404.534787:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314943872:12345-0@lo:503:mount.lustre.0 Request processed in 385us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.534795:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1789778404.535714:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778404.535810:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314943872:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789778404.537764:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789778404.537884:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778404.538345:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778404.538389:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e839580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778404.538894:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944000 00000100:00100000:3.0:1789778404.538903:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944000 00000100:00100000:3.0:1789778404.538963:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789778404.538973:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314944000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789778404.539706:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314944000:12345-0@lo:502:mount.lustre.0 Request processed in 733us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.539713:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789778404.539797:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789778404.541659:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789778404.541746:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789778404.541782:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789778404.541830:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789778404.541882:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789778404.541919:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789778404.541988:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789778404.542027:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789778404.542125:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789778404.542792:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778404.542883:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778404.542971:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e839580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778404.545014:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944128 00000100:00100000:0.0:1789778404.545027:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944128 00000100:00100000:0.0:1789778404.545107:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789778404.545117:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314944128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778404.545399:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314944128:12345-0@lo:502:mount.lustre.0 Request processed in 283us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.545407:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789778404.545542:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789778404.545652:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789778404.545667:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789778404.552008:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789778404.552020:0:15809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789778404.552026:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778404.552027:0:15809:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789778404.552032:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789778404.552057:0:15809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b3eb7008000) 00000020:00000080:3.0:1789778404.552088:0:15809:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789778404.552094:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789778404.552163:0:15809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3eabbab000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789778404.552173:0:15809:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789778404.552179:0:15809:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5a1e1c1157441fd3 00010000:00010000:3.0:1789778404.559092:0:15809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789778404.559850:0:15809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1789778404.564650:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789778404.567982:0:15809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789778404.567995:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778404.568001:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778404.568004:0:15809:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789778404.568007:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778404.568011:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778404.568012:0:15809:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789778404.568016:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789778404.568017:0:15809:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789778404.568019:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789778404.568022:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778404.568023:0:15809:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789778404.568025:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789778404.568028:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789778404.568029:0:15809:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789778404.568033:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789778404.568189:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789778404.568197:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789778404.568199:0:15809:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789778404.568203:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789778404.568342:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789778404.568386:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789778404.568411:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657200/0x5a1e1c1157441fbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fc5 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.568426:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e81657200/0x5a1e1c1157441fbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fc5 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778404.568437:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3eabbab000 from 1 10000000:01000000:2.0:1789778404.568441:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789778404.568488:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.568497:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.568510:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778404.568553:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789778404.568634:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.568671:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944256 00000100:00100000:0.0:1789778404.568678:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944256 00000100:00100000:2.0:1789778404.568679:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778404.568720:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789778404.568730:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:15808:x1876718314944256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789778404.568753:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778404.568769:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441fda expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.568965:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.568976:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.568991:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757800, rc 0) 00000100:00100000:0.0:1789778404.569035:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944256:12345-0@lo:101:mount.lustre.0 Request processed in 308us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.569041:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789778404.569958:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778404.569976:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.569995:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789778404.570659:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789778404.571255:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789778404.571516:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789778404.572107:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789778404.572253:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789778404.572264:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789778404.572344:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778404.572539:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778404.572590:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778404.572630:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944384 00000100:00100000:0.0:1789778404.572637:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944384 00000100:00100000:0.0:1789778404.572683:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789778404.572692:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789778404.572906:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944384:12345-0@lo:501:mount.lustre.0 Request processed in 213us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.572915:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789778404.572934:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789778404.572969:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789778404.573011:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778404.573032:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17b29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789778404.573050:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944512 00000100:00100000:0.0:1789778404.573055:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944512 00000100:00100000:0.0:1789778404.573101:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789778404.573109:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789778404.573362:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944512:12345-0@lo:503:mount.lustre.0 Request processed in 254us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.573368:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789778404.573396:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789778404.573841:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789778404.573910:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778404.573947:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778404.573974:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d2f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789778404.573980:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944640 00000100:00100000:0.0:1789778404.573985:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944640 00000100:00100000:0.0:1789778404.574016:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789778404.574020:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778404.574199:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944640:12345-0@lo:502:mount.lustre.0 Request processed in 177us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.574206:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789778404.574251:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789778404.574479:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789778404.574544:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789778404.574676:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789778404.574702:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789778404.574725:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789778404.574779:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789778404.574818:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789778404.574838:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789778404.574871:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778404.574900:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.574921:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09780 going to sleep for 11 seconds 00000100:00100000:1.0:1789778404.574936:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944768 00000100:00100000:1.0:1789778404.574942:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944768 00000100:00100000:1.0:1789778404.574976:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789778404.574985:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778404.575443:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944768:12345-0@lo:502:mount.lustre.0 Request processed in 459us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.575449:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789778404.575549:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789778404.575633:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789778404.575648:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789778404.579310:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778404.579322:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778404.579324:0:15813:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789778404.579330:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3eabbab000 00000020:00000080:1.0:1789778404.579332:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789778404.579337:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778404.579338:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778404.579339:0:15813:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789778404.579341:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778404.579342:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778404.579343:0:15813:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789778404.579344:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3eabbab000 00000020:00000080:1.0:1789778404.579345:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789778404.579395:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778404.579399:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778404.579400:0:15813:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789778404.579403:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789778404.579406:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778404.579407:0:15813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789778404.579411:0:15813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3eabbab000 00000020:00000080:1.0:1789778404.579413:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789778404.579443:0:15813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789778404.579447:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789778404.579448:0:15813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789778404.579451:0:15813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789778404.579696:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789778404.579736:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789778404.579787:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.579800:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778404.579850:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789778404.579864:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3eabbab000 10000000:01000000:0.0:1789778404.579867:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3eabbab000 10000000:01000000:0.0:1789778404.579872:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789778404.579878:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b3eabbab000 from 1 10000000:01000000:0.0:1789778404.579881:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789778404.579919:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157441fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.579934:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157441fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.579945:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157441fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778404.579968:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789778404.580056:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.580114:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09540 going to sleep for 11 seconds 00000100:00100000:2.0:1789778404.580681:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314944896 00000100:00100000:2.0:1789778404.580688:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314944896 00000100:00100000:2.0:1789778404.580727:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789778404.580736:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314944896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789778404.580759:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778404.580770:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81656600/0x5a1e1c1157441fef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157441fe8 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.580795:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656600/0x5a1e1c1157441fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157441fe8 expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.580811:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81656600/0x5a1e1c1157441fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441fe8 expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.580817:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656600, rc 0) 00000100:00100000:2.0:1789778404.580864:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314944896:12345-0@lo:101:mount.lustre.0 Request processed in 120us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778404.580871:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789778404.580892:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314944896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789778404.580907:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157441fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fef expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778404.580916:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157441fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157441fef expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789778404.581732:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789778404.582277:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789778404.582524:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789778404.582569:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789778404.582607:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789778404.582655:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789778404.582702:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789778404.582754:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789778404.582793:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789778404.582831:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789778404.582892:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789778404.582932:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789778404.582977:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789778404.583025:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789778404.583061:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789778404.583135:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789778404.583199:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789778404.583235:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789778404.583264:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789778404.583312:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789778404.583347:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789778404.583379:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789778404.583428:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789778404.583463:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789778404.583499:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789778404.583548:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789778404.583585:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789778404.583620:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789778404.583669:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789778404.583706:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789778404.583740:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789778404.583812:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789778404.583863:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789778404.583903:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789778404.583936:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789778404.583998:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789778404.584040:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789778404.584113:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789778404.584152:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789778404.584230:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789778404.584240:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789778404.584325:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789778404.584383:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.584424:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09540 going to sleep for 11 seconds 00000100:00100000:1.0:1789778404.584767:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945024 00000100:00100000:1.0:1789778404.584775:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945024 00000100:00100000:1.0:1789778404.584823:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789778404.584832:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789778404.585059:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945024:12345-0@lo:501:mount.lustre.0 Request processed in 227us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778404.585094:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789778404.585348:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789778404.585381:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789778404.585418:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.585541:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d09540 going to sleep for 11 seconds 00000100:00100000:1.0:1789778404.585575:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945152 00000100:00100000:1.0:1789778404.585580:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945152 00000100:00100000:1.0:1789778404.585637:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789778404.585644:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789778404.585920:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945152:12345-0@lo:503:mount.lustre.0 Request processed in 276us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778404.585927:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789778404.585982:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945152:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789778404.586721:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789778404.586782:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778404.586823:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.586850:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945280 00000100:00100000:0.0:1789778404.586864:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945280 00000100:00100000:0.0:1789778404.586891:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789778404.586898:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778404.587327:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945280:12345-0@lo:502:mount.lustre.0 Request processed in 428us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.587334:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789778404.587378:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957daf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789778404.587393:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789778404.587679:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789778404.587729:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789778404.587766:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789778404.587813:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789778404.587875:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789778404.587926:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789778404.587963:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789778404.588000:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789778404.588280:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789778404.588318:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789778404.588359:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789778404.588401:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789778404.588435:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789778404.588540:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789778404.588593:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789778404.588631:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789778404.588667:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789778404.588715:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789778404.588753:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789778404.588789:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789778404.588861:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789778404.588902:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789778404.588937:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789778404.588985:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789778404.589023:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789778404.589352:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789778404.589405:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789778404.589443:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789778404.589559:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789778404.589634:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789778404.589675:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789778404.589712:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789778404.589748:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789778404.589799:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789778404.589838:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789778404.589912:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789778404.589964:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789778404.589998:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789778404.590277:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789778404.590318:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789778404.590362:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789778404.590428:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.590578:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e957daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778404.590619:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945408 00000100:00100000:1.0:1789778404.590626:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945408 00000100:00100000:1.0:1789778404.590702:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789778404.590713:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789778404.590932:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945408:12345-0@lo:502:mount.lustre.0 Request processed in 220us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778404.590939:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789778404.591009:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789778404.591114:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789778404.591126:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789778404.599755:0:15816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789778404.599773:0:15816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b3e85d04d28) 00000020:00000080:0.0:1789778404.599794:0:15816:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789778404.599880:0:15816:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3eabbab000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789778404.599884:0:15816:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3eabbab000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789778404.599887:0:15816:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3eabbab000 3 00010000:00080000:0.0:1789778404.599914:0:15816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3ebf7de000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.145@tcp at head 00010000:00010000:0.0:1789778404.604979:0:15816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789778404.605529:0:15816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789778404.605574:0:15816:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789778404.605587:0:15816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5a1e1c1157441ffd 00000100:00080000:0.0:1789778404.605598:0:15816:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789778404.605605:0:15816:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b3ebf7de000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:0.0:1789778404.605641:0:15816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ec17a9f80 x1876718314945536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789778404.605664:0:15816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789778404.605723:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314945536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789778404.605797:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778404.605936:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945536 00000100:00100000:0.0:1789778404.605944:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945536 00000100:00100000:0.0:1789778404.605972:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789778404.605979:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876718314945536:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789778404.606001:0:14409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1789778404.608296:0:14409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5a1e1c1157442004 00000004:00100000:0.0:1789778404.608318:0:14409:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789778404.608363:0:14409:0:(import.c:65:import_set_state_nolock()) ffff9b3e84ef7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778404.608441:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876718314945536:12345-0@lo:38:llog_process_th.0 Request processed in 2460us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778404.608451:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789778404.608579:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3ec17a9f80 x1876718314945536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789778414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789778404.608592:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789778404.608600:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789778404.608608:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789778404.608612:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789778404.608614:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3ebf7de000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789778404.608619:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876718314945536:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789778404.609746:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789778404.610108:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789778404.610135:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789778404.610159:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157441fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fef expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.610171:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95757400/0x5a1e1c1157441fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157441fef expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789778404.610272:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789778404.610274:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778404.610276:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778404.610277:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778404.610278:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778404.610279:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778404.610281:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778404.610283:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778404.610284:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789778404.610288:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789778404.610290:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789778404.610291:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778404.610293:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778404.610294:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778404.610295:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778404.610296:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778404.610297:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778404.610302:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778404.610302:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789778404.610325:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789778404.610343:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789778404.610526:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778404.610629:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945664 00000100:00100000:1.0:1789778404.610637:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945664 00000100:00100000:1.0:1789778404.610683:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789778404.610693:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:15808:x1876718314945664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789778404.610719:0:14401:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789778404.610731:0:14401:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789778404.610903:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9075eb40 going to sleep for 11 seconds 20000000:01000000:3.0:1789778404.636721:0:14401:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789778404.636769:0:14401:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789778404.636980:0:14423:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789778404.636986:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789778404.637007:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.637026:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.637117:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.637285:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.637298:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 19 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778404.637310:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14423:1876718314945792:0@lo:104: 00000100:00100000:2.0:1789778404.637361:0:14423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778404.637440:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e9097d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789778404.637788:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945792 00000100:00100000:3.0:1789778404.637795:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945792 00000100:00100000:3.0:1789778404.637846:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789778404.637864:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14423:x1876718314945792:12345-0@lo:104: 00010000:00010000:3.0:1789778404.637881:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778404.639351:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789778404.639358:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:14423:x1876718314945792:12345-0@lo:104: Request processed in 1505us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778404.639365:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789778404.639621:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14423:1876718314945792:0@lo:104: 00010000:00010000:2.0:1789778404.639643:0:14423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.639994:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789778404.640001:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.640009:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:1.0:1789778404.640023:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.640166:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789778404.640175:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778404.640181:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789778404.640335:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.640343:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789778404.640369:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778404.640370:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314945920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778404.640376:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95756800/0x5a1e1c1157441ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441ede expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.640392:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.640394:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778404.640396:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778404.640422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778404.640466:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314945920 00000100:00100000:2.0:1789778404.640480:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314945920 00010000:00010000:2.0:1789778404.640500:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 20 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778404.640525:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789778404.640534:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+20:3312:x1876718314945920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778404.640836:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778404.640848:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 20 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640869:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 20 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640882:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ebf44da00/0x5a1e1c1157441ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157441ed7 expref: 20 pid: 14402 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640896:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640904:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789778404.640919:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003933329s 00010000:00010000:2.0:1789778404.640923:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640930:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640947:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640954:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640960:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778404.640963:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640972:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.640992:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778404.641001:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778404.641033:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3312:x1876718314945920:12345-0@lo:103:ldlm_bl.0 Request processed in 500us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778404.641041:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789778404.641104:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314945920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789778404.641462:0:14423:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.641468:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778404.641473:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81656800/0x5a1e1c115744200b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778404.643826:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:15808:x1876718314945664:12345-0@lo:253:mount.lustre.0 Request processed in 33128us (33294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778404.643839:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789778404.643965:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:15808:1876718314945664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789778404.643980:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789778404.643982:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789778404.643983:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789778404.643984:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789778404.643985:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789778404.643986:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789778404.643987:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789778404.643998:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789778404.643999:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789778404.644000:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789778404.644019:0:15808:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789778404.648362:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778404.648740:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789778404.648902:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778404.648998:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789778404.649568:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789778404.649874:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789778404.650831:0:15808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789778404.696173:0:15808:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789778404.696182:0:15808:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789778404.696233:0:15808:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789778404.696278:0:15808:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.145@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789778404.696290:0:15808:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789778404.696313:0:15808:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789778405.554392:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778406.577193:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789778406.577286:0:14405:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789778406.577290:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b3ec17e1800 from 8 10000000:01000000:2.0:1789778406.577295:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789778406.577340:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657c00/0x5a1e1c1157442012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778406.577351:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e81657c00/0x5a1e1c1157442012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778406.577360:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e81657c00/0x5a1e1c1157442012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778406.577385:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314946048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789778406.577474:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778406.577521:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e91ab8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789778406.577636:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946048 00000100:00100000:1.0:1789778406.577644:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946048 00000100:00100000:1.0:1789778406.577697:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789778406.577716:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:14405:x1876718314946048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789778406.577728:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778406.577742:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157442019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157442012 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778406.577763:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157442019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157442012 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778406.577773:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d82320400/0x5a1e1c1157442019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157442012 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778406.577781:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d82320400, rc 0) 00000100:00100000:1.0:1789778406.577842:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314946048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778406.577849:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789778406.578034:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314946048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778406.578049:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e81657c00/0x5a1e1c1157442012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157442019 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778406.578059:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657c00/0x5a1e1c1157442012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157442019 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778406.578138:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314946176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789778406.578171:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778406.578186:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e91ab8240 going to sleep for 11 seconds 00000100:00100000:0.0:1789778406.578282:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946176 00000100:00100000:0.0:1789778406.578287:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946176 00000100:00100000:0.0:1789778406.578319:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789778406.578326:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314946176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789778406.578338:0:14401:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789778406.578355:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789778406.578358:0:14401:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789778406.578527:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314946176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778406.578535:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789778406.578554:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314946176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789778406.578609:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789778406.578616:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657c00/0x5a1e1c1157442012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157442019 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778406.578624:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e81657c00/0x5a1e1c1157442012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157442019 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789778407.519391:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789778407.519476:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789778407.606578:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778408.628643:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778409.394429:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789778409.394453:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314946304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789778409.394571:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778409.394654:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946304 00000100:00100000:2.0:1789778409.394661:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946304 00000100:00100000:2.0:1789778409.394719:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778409.394728:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314946304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778409.394764:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778409.394851:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314946304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778409.394859:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789778409.394880:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789778409.394926:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789778409.394948:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314946304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789778409.650288:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789778409.906106:0:15897:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789778409.906112:0:15897:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789778409.906117:0:15897:0:(import.c:65:import_set_state_nolock()) ffff9b3e88d7f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789778409.906125:0:15897:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1789778409.906131:0:15897:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789778409.906137:0:15897:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3e88d7f000 using connection 192.168.201.145@tcp/0@lo 00000100:00100000:3.0:1789778409.906160:0:15897:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3ebfbec000 x1876718314946560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789778409.906226:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314946688:0@lo:400:kworker.0 00000100:00100000:3.0:1789778409.906292:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778409.906355:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789778409.906362:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314946432:0@lo:400:kworker.0 00000100:00100000:3.0:1789778409.906407:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778409.906441:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314946560:0@lo:8:kworker.0 00000100:00100000:3.0:1789778409.906469:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778409.906496:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314946816:0@lo:400:kworker.0 00000100:00100000:3.0:1789778409.906638:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778409.906662:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789778409.906667:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314946944:0@lo:400:kworker.0 00000100:00100000:3.0:1789778409.906695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778409.906741:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946688 00000100:00100000:3.0:1789778409.906749:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946688 00000100:00100000:3.0:1789778409.906813:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946816 00000100:00100000:3.0:1789778409.906816:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946816 00000100:00100000:3.0:1789778409.906837:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946944 00000100:00100000:3.0:1789778409.906839:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946944 00000100:00100000:3.0:1789778409.906854:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778409.906862:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314946688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778409.906909:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314946688:12345-0@lo:400:kworker.0 Request processed in 48us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778409.906916:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789778409.906931:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789778409.906937:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314946816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778409.907152:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946560 00000100:00100000:2.0:1789778409.907157:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946560 00000100:00100000:2.0:1789778409.907182:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778409.907187:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876718314946560:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789778409.907210:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1789778409.907253:0:15093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5a1e1c1157442020 00002000:00100000:2.0:1789778409.907267:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b3d8376c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789778409.907271:0:15093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789778409.907274:0:15093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789778409.907738:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789778409.907772:0:15093:0:(import.c:65:import_set_state_nolock()) ffff9b3d83769800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789778409.912275:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876718314946560:12345-0@lo:8:kworker.0 Request processed in 5076us (5794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778409.912290:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789778409.912332:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778409.912846:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789778409.912856:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789778409.912869:0:14409:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789778409.912878:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778409.912891:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314946944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778409.914486:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314946944:12345-0@lo:400:kworker.0 Request processed in 1594us (7785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778409.914508:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789778409.914556:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314946432 00000100:00100000:2.0:1789778409.914564:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314946432 00000100:00100000:2.0:1789778409.914605:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789778409.914613:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3311:x1876718314946432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778409.914666:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3311:x1876718314946432:12345-0@lo:400:kworker.0 Request processed in 53us (8259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778409.914673:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789778409.914726:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314946432:0@lo:400:kworker.0 00010000:00080000:2.0:1789778409.914744:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbed180 x1876718314946688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778409.914768:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314946688:0@lo:400:kworker.0 00010000:00080000:2.0:1789778409.914824:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec000 x1876718314946560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789778434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778409.914833:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789778409.914840:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789778409.914848:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789778409.914852:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789778409.914855:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9b3e88d7f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789778409.914867:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789778409.914873:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876718314946560:0@lo:8:kworker.0 00010000:00080000:2.0:1789778409.914904:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbeea00 x1876718314946944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778409.914928:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314946944:0@lo:400:kworker.0 00000100:00100000:3.0:1789778409.922984:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314946816:12345-0@lo:400:kworker.0 Request processed in 16023us (16322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778409.923003:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:3.0:1789778409.923265:0:14432:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789778409.923289:0:14432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14432:1876718314947200:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789778409.923349:0:14432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778409.923374:0:14432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e91ab8780 going to sleep for 11 seconds 00010000:00080000:2.0:1789778409.924590:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbec700 x1876718314946816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789778425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778409.924606:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314946816:0@lo:400:kworker.0 00000100:00100000:2.0:1789778409.925147:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778409.925162:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314947072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778409.925217:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778409.925263:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947072 00000100:00100000:2.0:1789778409.925270:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947072 00000100:00100000:2.0:1789778409.925330:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789778409.925340:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314947072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778409.925374:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778409.925429:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314947072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778409.925437:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789778409.925461:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789778409.925483:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3ebfbedf80 x1876718314947072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789778425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789778409.925499:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314947072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778409.925531:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947200 00000100:00100000:2.0:1789778409.925536:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947200 00000100:00100000:2.0:1789778409.925564:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789778409.925572:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14432:x1876718314947200:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789778409.928724:0:14431:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789778409.929088:0:14431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464887022266ns, next at 0ns, rc = 0 00002000:00080000:3.0:1789778409.950773:0:15095:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789778409.950787:0:15095:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789778409.950793:0:15095:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789778409.982704:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778409.982717:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.982747:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778409.982751:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778409.982770:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.982789:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.982801:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.982809:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.982834:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789778409.983304:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778409.983310:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983319:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778409.983322:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778409.983327:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983337:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983356:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983364:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983380:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789778409.983395:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778409.983403:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983411:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778409.983416:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983426:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983442:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983450:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5085f69/0x5a1e1c1157442027 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983467:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778409.983476:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983483:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778409.983486:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983494:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983505:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983513:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ade700d/0x5a1e1c115744202e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.983526:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.983528:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.983530:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778409.984114:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778409.984120:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984131:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778409.984134:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778409.984139:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984162:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984171:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984178:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984193:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778409.984201:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778409.984205:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984213:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778409.984216:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984224:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984235:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984243:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c1157442035 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984264:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.984266:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.984267:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778409.984682:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778409.984688:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984698:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778409.984701:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778409.984705:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984716:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984724:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984733:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984746:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778409.984755:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778409.984772:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984791:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778409.984794:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984803:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984815:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984824:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c115744203c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.984838:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.984840:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.984842:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778409.985264:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778409.985270:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985279:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778409.985283:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778409.985287:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985296:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985311:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985317:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985331:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778409.985339:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778409.985342:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985349:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657000 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778409.985352:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985361:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985372:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985380:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c1157442043 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778409.985394:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.985401:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778409.985403:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778409.986033:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778410.000003:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778410.000018:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.000035:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778410.000040:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778410.000046:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.000258:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.000270:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.000277:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.000330:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789778410.001002:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778410.001008:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.001020:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778410.001024:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778410.001028:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.001047:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.004610:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.004631:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015203:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789778410.015219:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015234:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.015279:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015292:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015317:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015326:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fed51e3/0x5a1e1c115744204a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015434:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778410.015453:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015461:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.015465:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015474:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015485:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.015493:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.015501:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.015503:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.016092:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789778410.016102:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442051 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789778410.016836:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778410.016843:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.016855:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778410.016860:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778410.016865:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.016876:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.016895:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.016902:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.016919:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778410.017119:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.017125:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.017133:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.017137:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.017145:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.017158:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.017164:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c1157442058 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.017179:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.017187:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.017188:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.018082:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778410.018717:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778410.018726:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.018740:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778410.018744:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778410.018749:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.018772:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.018783:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.018791:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.018808:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789778410.019309:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778410.019316:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.019327:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778410.019331:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778410.019335:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.019352:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.019361:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.019369:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.022799:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.022813:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.022824:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657000 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.022829:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.022839:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.022863:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.022870:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1af601d/0x5a1e1c115744205f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.022910:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.022911:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.022913:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.022928:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789778410.027626:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778410.027640:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.027655:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.027660:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.027672:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.027695:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.027703:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442066 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.027724:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.027726:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.027728:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789778410.028139:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778410.028147:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.028160:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778410.028165:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778410.028171:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.028182:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.028191:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.028199:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.028218:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789778410.033783:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789778410.033798:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.033828:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789778410.033832:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778410.033838:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.033852:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.033864:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.033873:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.033895:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789778410.033908:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778410.033915:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.033923:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.033928:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.033938:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778410.034122:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1789778410.034903:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789778410.034912:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778410.034924:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1789778410.034927:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778410.034932:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778410.034943:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778410.034952:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.036127:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.036142:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36a87a4/0x5a1e1c115744206d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.036165:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.036167:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.036170:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778410.036323:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.039257:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778410.039475:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.039484:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.039498:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.039503:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040016:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040041:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040049:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccd5847e/0x5a1e1c115744207b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040105:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040107:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040109:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040159:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040162:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040163:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040170:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040179:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.040182:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040191:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040203:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040211:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000178a21a9/0x5a1e1c1157442074 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.040227:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040229:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.040231:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789778410.041942:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789778410.042451:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.042458:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.042475:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1789778410.042478:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.042482:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.042492:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.042499:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.042504:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.048164:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789778410.050181:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.050192:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.050209:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.050214:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.050221:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.050238:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.050260:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.050268:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.050298:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789778410.051722:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.051732:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.051747:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.051750:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.052010:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.052027:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.052038:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.052046:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052320:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778410.052335:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052345:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.052350:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052361:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052380:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052388:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee18a946/0x5a1e1c1157442082 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052405:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.052409:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052415:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.052418:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052426:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052448:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052455:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5871ad9/0x5a1e1c1157442089 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.052468:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.052470:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.052472:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778410.052805:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789778410.053322:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.053329:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.053339:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.053343:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.053348:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.053358:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.053367:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.053374:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057686:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778410.057700:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057713:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.057718:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057728:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057750:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057769:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f39f72/0x5a1e1c1157442090 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057803:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.057807:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057814:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321400 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.057818:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057825:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057836:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.057843:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.057844:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.057846:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778410.058412:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789778410.058421:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef75d6f/0x5a1e1c1157442097 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789778410.058967:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789778410.059248:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.059255:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.059276:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.059281:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.059287:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.059297:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.059306:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.059313:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.059327:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789778410.060147:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.060155:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.060167:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.060171:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.060174:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.060183:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.060202:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.060209:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.060217:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789778410.062283:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.062295:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.062309:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.062313:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.062319:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.062331:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.062342:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.062350:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063153:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789778410.063163:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063175:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.063181:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063208:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063226:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063235:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcbac6fd/0x5a1e1c115744209e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063256:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778410.063260:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063268:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.063272:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063280:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063289:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063296:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ab96a26/0x5a1e1c11574420a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063321:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.063325:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063332:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321000 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.063335:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063343:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063354:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.063362:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.063364:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.063366:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778410.063465:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789778410.063472:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007305d34b/0x5a1e1c11574420ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.064479:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.065280:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789778410.065298:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.065306:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.065320:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.065325:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.065331:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.065343:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.065353:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.065360:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.067259:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789778410.067887:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.067896:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.067917:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.067921:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.067927:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.067942:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.067952:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.067972:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.077308:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789778410.077328:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.077363:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.077368:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086037:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086107:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086117:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000457fe823/0x5a1e1c11574420b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086149:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778410.086154:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086162:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.086166:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086176:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086185:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.086210:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.086212:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.086215:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789778410.087190:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789778410.087200:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051a4276a/0x5a1e1c11574420ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789778410.087880:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.087889:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.087903:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.087908:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.087915:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.087942:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.087953:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.087960:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.087977:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778410.088212:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.088220:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.088228:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82320600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.088233:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.088254:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.088269:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.088278:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064cdeeca/0x5a1e1c11574420c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.088295:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.088297:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.088299:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789778410.089354:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.089362:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.089374:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.091475:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.091485:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.091504:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.092015:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.092039:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.092198:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789778410.093156:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.093164:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.093179:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.093182:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.093188:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.093198:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.093207:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.093215:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.096051:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789778410.096313:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789778410.098210:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.098223:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.098245:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.098250:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.098256:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.098270:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.098281:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.098288:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.098302:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789778410.098534:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098542:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.098546:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098555:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098574:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098581:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006526ea3/0x5a1e1c11574420c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098604:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789778410.098608:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098614:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.098622:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098630:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098640:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098647:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9505c1d/0x5a1e1c11574420cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098659:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789778410.098662:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098668:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d82321e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:3.0:1789778410.098671:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098678:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098688:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098696:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6a03b7/0x5a1e1c11574420d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778410.098716:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.098718:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.098721:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778410.098769:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789778410.102199:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789778410.102213:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.102230:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789778410.102234:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778410.102241:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.102256:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.102280:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.102288:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778410.102364:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789778410.104226:0:15095:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1789778410.104343:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14432:x1876718314947200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 178767us (180988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778410.104360:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789778410.105184:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778410.105194:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.105206:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f76a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778410.105210:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.105219:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.105237:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.105261:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574420dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778410.105283:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778410.105285:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778410.105286:0:14432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14432:1876718314947200:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1789778410.105287:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789778410.105302:0:14432:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789778410.105353:0:14432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14432:1876718314947328:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789778410.105396:0:14432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778410.105447:0:14432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eba73aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789778410.105458:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947328 00000100:00100000:2.0:1789778410.105465:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947328 00000100:00100000:2.0:1789778410.105518:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789778410.105528:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14432:x1876718314947328:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789778410.105570:0:15094:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1789778410.114525:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778410.135587:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14432:x1876718314947328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 29973us (30104us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789778410.135603:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789778410.139469:0:14432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14432:1876718314947328:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789778410.139488:0:14432:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1789778410.675848:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789778411.697858:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789778411.789565:0:16168:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg145-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789778411.956563:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789778412.731031:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778413.750509:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778414.289276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778414.289378:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296080512 00000100:00100000:1.0:1789778414.289388:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296080512 00000100:00100000:1.0:1789778414.289436:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:1.0:1789778414.289445:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2371:x1876718296080512:12345-192.168.201.45@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789778414.289473:0:14401:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5f7eb169-d267-4201-9b8c-0564b642e934@192.168.201.45@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1789778414.289509:0:14401:0:(genops.c:1385:class_connect()) connect: client 5f7eb169-d267-4201-9b8c-0564b642e934, cookie 0x5a1e1c11574420e4 00000100:00080000:1.0:1789778414.289669:0:14401:0:(import.c:65:import_set_state_nolock()) ffff9b3eb4d8d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789778414.290043:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+5:2371:x1876718296080512:12345-192.168.201.45@tcp:250:mount.lustre.0 Request processed in 596us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.290051:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 76 00000100:00100000:2.0:1789778414.307528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.311377:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296080640 00000100:00100000:0.0:1789778414.311395:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296080640 00000100:00100000:0.0:1789778414.311466:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:0.0:1789778414.311476:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+5:13782:x1876718296080640:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789778414.311495:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778414.311514:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95757000/0x5a1e1c11574420eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7f11 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778414.311545:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95757000/0x5a1e1c11574420eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f11 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778414.311557:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95757000/0x5a1e1c11574420eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f11 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778414.311568:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757000, rc 0) 00000100:00100000:0.0:1789778414.312295:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+6:13782:x1876718296080640:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 816us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.312305:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 77 00000100:00100000:3.0:1789778414.322635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778414.323198:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296080768 00000100:00100000:2.0:1789778414.323210:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296080768 00000100:00100000:2.0:1789778414.323331:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:2.0:1789778414.323343:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+6:13782:x1876718296080768:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789778414.323627:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+6:13782:x1876718296080768:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 286us (1003us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789778414.323635:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 78 00000100:00100000:3.0:1789778414.334167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778414.337859:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296080896 00000100:00100000:1.0:1789778414.337877:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296080896 00000100:00100000:1.0:1789778414.338669:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:1.0:1789778414.338693:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+6:13782:x1876718296080896:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789778414.338729:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778414.338759:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d81f77a00/0x5a1e1c11574420f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7f18 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.338794:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d81f77a00/0x5a1e1c11574420f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f18 expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.338806:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d81f77a00/0x5a1e1c11574420f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f18 expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.338816:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f77a00, rc 0) 00000100:00100000:1.0:1789778414.338890:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+7:13782:x1876718296080896:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 210us (4737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.338897:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 79 00000100:00100000:3.0:1789778414.341151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778414.341199:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081024 00000100:00100000:1.0:1789778414.341209:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081024 00000100:00100000:1.0:1789778414.341262:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:1.0:1789778414.341272:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+7:13782:x1876718296081024:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789778414.341593:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+8:13782:x1876718296081024:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 321us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.341602:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 80 00000100:00100000:3.0:1789778414.350189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.350248:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081152 00000100:00100000:0.0:1789778414.350259:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081152 00000100:00100000:0.0:1789778414.350375:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:0.0:1789778414.350386:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+8:13782:x1876718296081152:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789778414.350632:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+8:13782:x1876718296081152:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 247us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.350641:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 81 00000100:00100000:3.0:1789778414.354274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778414.354339:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081280 00000100:00100000:1.0:1789778414.354350:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081280 00000100:00100000:1.0:1789778414.354412:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:1.0:1789778414.354421:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e87dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+8:13801:x1876718296081280:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789778414.354647:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e87dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+8:13801:x1876718296081280:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 226us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.355263:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 82 00000100:00100000:0.0:1789778414.366999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778414.367277:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081408 00000100:00100000:2.0:1789778414.367305:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081408 00000100:00100000:0.0:1789778414.367487:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:0.0:1789778414.367499:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+8:13801:x1876718296081408:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789778414.367839:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1446850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+8:13801:x1876718296081408:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 341us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.367848:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 83 00000100:00100000:3.0:1789778414.392844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778414.392926:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081536 00000100:00100000:1.0:1789778414.392938:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081536 00000100:00100000:1.0:1789778414.393005:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:1.0:1789778414.393026:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+8:13782:x1876718296081536:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789778414.393046:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778414.393106:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d81f77c00/0x5a1e1c11574420f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7f42 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.393137:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d81f77c00/0x5a1e1c11574420f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f42 expref: 9 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.393149:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d81f77c00/0x5a1e1c11574420f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f42 expref: 9 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.393159:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f77c00, rc 0) 00000100:00100000:1.0:1789778414.393216:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+9:13782:x1876718296081536:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 192us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.393224:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 84 00000100:00100000:3.0:1789778414.399550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.399660:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081664 00000100:00100000:0.0:1789778414.399670:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081664 00000100:00100000:0.0:1789778414.399808:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:0.0:1789778414.399985:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+9:13782:x1876718296081664:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789778414.400099:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789778414.400124:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789778414.400128:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789778414.400132:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789778414.400134:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789778414.402469:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+9:13782:x1876718296081664:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 2644us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.402484:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 85 00000100:00100000:0.0:1789778414.411408:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778414.411878:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081792 00000100:00100000:2.0:1789778414.411888:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081792 00000100:00100000:2.0:1789778414.411986:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:2.0:1789778414.411994:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+9:13782:x1876718296081792:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789778414.412014:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778414.412032:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7f49 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778414.412101:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778414.412113:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778414.412121:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656200, rc 0) 00000100:00100000:2.0:1789778414.412190:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+10:13782:x1876718296081792:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 197us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778414.412198:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 86 00000100:00100000:0.0:1789778414.423395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778414.423904:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296081920 00000100:00100000:2.0:1789778414.423913:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296081920 00000100:00100000:2.0:1789778414.423955:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:2.0:1789778414.423962:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+10:13782:x1876718296081920:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789778414.425178:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+10:13782:x1876718296081920:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 1213us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778414.425185:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 87 00000100:00100000:3.0:1789778414.427993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.438056:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082048 00000100:00100000:0.0:1789778414.438086:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082048 00000100:00100000:0.0:1789778414.438152:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:0.0:1789778414.438178:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+10:13782:x1876718296082048:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789778414.438393:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+10:13782:x1876718296082048:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 216us (10408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.438401:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 88 00000100:00100000:0.0:1789778414.444254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778414.445876:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082176 00000100:00100000:1.0:1789778414.445890:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082176 00000100:00100000:1.0:1789778414.445957:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:1.0:1789778414.445966:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+10:13805:x1876718296082176:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789778414.446413:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+10:13805:x1876718296082176:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 445us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.446421:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 89 00000100:00100000:1.0:1789778414.455442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.455557:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082304 00000100:00100000:0.0:1789778414.455570:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082304 00000100:00100000:0.0:1789778414.455639:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:0.0:1789778414.455660:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+10:13805:x1876718296082304:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789778414.456233:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+10:13805:x1876718296082304:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 583us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.456241:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 90 00000100:00100000:0.0:1789778414.469529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778414.469733:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082432 00000100:00100000:2.0:1789778414.469744:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082432 00000100:00100000:2.0:1789778414.469805:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1789778414.469814:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2371:x1876718296082432:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789778414.469846:0:14409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 994018b1-ce46-430d-a31b-a5e08e23dff3@192.168.201.45@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1789778414.469909:0:14409:0:(genops.c:1385:class_connect()) connect: client 994018b1-ce46-430d-a31b-a5e08e23dff3, cookie 0x5a1e1c1157442107 00000004:00100000:2.0:1789778414.469941:0:14409:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789778414.469948:0:14409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789778414.513547:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314947456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789778414.513632:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778414.513756:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947456 00000100:00100000:1.0:1789778414.513779:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947456 00000100:00100000:1.0:1789778414.513841:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789778414.513852:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314947456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789778414.513888:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789778414.514021:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778414.515367:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314947456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1510us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.515379:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789778414.515557:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314947456:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789778414.521402:0:14409:0:(import.c:65:import_set_state_nolock()) ffff9b3eabbaf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789778414.521561:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2371:x1876718296082432:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 51744us (52039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.521577:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1789778414.527586:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778414.527687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778414.527982:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082688 00000100:00100000:3.0:1789778414.527996:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082688 00000100:00100000:3.0:1789778414.528090:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082560 00000100:00100000:3.0:1789778414.528094:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082560 00000100:00100000:3.0:1789778414.528139:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1789778414.528151:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:13782:x1876718296082688:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789778414.528372:0:16026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789778414.528477:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:13782:x1876718296082688:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 329us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778414.528485:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1789778414.528504:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:3.0:1789778414.528511:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+6:0:x1876718296082560:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789778414.528522:0:16026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789778414.528540:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+6:0:x1876718296082560:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 31us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778414.528546:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00080000:2.0:1789778414.530549:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778414.537808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778414.543344:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082816 00000100:00100000:3.0:1789778414.543364:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082816 00000100:00100000:3.0:1789778414.543439:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:3.0:1789778414.543452:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+6:13782:x1876718296082816:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789778414.543558:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+6:13782:x1876718296082816:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 109us (5764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778414.543574:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778414.551714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.551757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.551804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778414.551842:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296082944 00000100:00100000:0.0:1789778414.551853:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296082944 00000100:00100000:0.0:1789778414.552006:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083072 00000100:00100000:0.0:1789778414.552009:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083072 00000100:00100000:0.0:1789778414.552022:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778414.552031:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1876718296082944:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789778414.552090:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 994018b1-ce46-430d-a31b-a5e08e23dff3@192.168.201.45@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:0.0:1789778414.552118:0:15093:0:(genops.c:1385:class_connect()) connect: client 994018b1-ce46-430d-a31b-a5e08e23dff3, cookie 0x5a1e1c115744210e 00002000:00100000:0.0:1789778414.552313:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 994018b1-ce46-430d-a31b-a5e08e23dff3/ffff9b3eb7015000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789778414.552326:0:15093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789778414.552363:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083200 00000100:00100000:2.0:1789778414.552370:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083200 00000100:00100000:2.0:1789778414.552429:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1789778414.552440:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+6:13782:x1876718296083200:12345-192.168.201.45@tcp:33:mount.lustre.0 00002000:00080000:0.0:1789778414.552721:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789778414.552755:0:15093:0:(import.c:65:import_set_state_nolock()) ffff9b3eb7012000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778414.552814:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2371:x1876718296082944:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 783us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.552822:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778414.552840:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1789778414.552845:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1876718296083072:12345-192.168.201.45@tcp:8:mount.lustre.0 00000004:00080000:2.0:1789778414.553011:0:14410:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 505us 00010000:00080000:0.0:1789778414.556370:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 994018b1-ce46-430d-a31b-a5e08e23dff3@192.168.201.45@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:0.0:1789778414.556411:0:15093:0:(genops.c:1385:class_connect()) connect: client 994018b1-ce46-430d-a31b-a5e08e23dff3, cookie 0x5a1e1c1157442115 00002000:00100000:0.0:1789778414.556426:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 994018b1-ce46-430d-a31b-a5e08e23dff3/ffff9b3eb7013000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789778414.556453:0:15093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789778414.556650:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789778414.556690:0:15093:0:(import.c:65:import_set_state_nolock()) ffff9b3eb7016800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778414.556753:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2371:x1876718296083072:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 3906us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778414.556763:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000004:00200000:2.0:1789778414.576204:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789778414.576446:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+6:13782:x1876718296083200:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 24002us (24738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778414.576458:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00010000:00010000:3.0:1789778414.769431:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778414.828822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778414.829387:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083328 00000100:00100000:1.0:1789778414.829400:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083328 00000100:00100000:1.0:1789778414.829474:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1789778414.829486:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+6:13826:x1876718296083328:12345-192.168.201.45@tcp:101:mkdir.0 00010000:00010000:1.0:1789778414.829509:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778414.829541:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76c00/0x5a1e1c115744211c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7f73 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.829608:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c1157442123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.829621:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c1157442123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.829633:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c1157442123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778414.829690:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789778414.829694:0:14407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778414.829747:0:14407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c1157442123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.829770:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76c00/0x5a1e1c115744211c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f73 expref: 8 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.829786:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c1157442123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f73 expref: 7 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778414.829793:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:1.0:1789778414.829796:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778414.829800:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f77e00, rc 0) 00000100:00100000:1.0:1789778414.831094:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+7:13826:x1876718296083328:12345-192.168.201.45@tcp:101:mkdir.0 Request processed in 1582us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778414.831104:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1789778415.025625:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314947584:0@lo:400:kworker.0 00000100:00100000:0.0:1789778415.025740:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778415.026684:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947584 00000100:00100000:1.0:1789778415.026695:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947584 00000100:00100000:1.0:1789778415.026745:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789778415.026754:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3312:x1876718314947584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778415.035268:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314948096:0@lo:400:kworker.0 00000100:00100000:0.0:1789778415.035413:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778415.037190:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3312:x1876718314947584:12345-0@lo:400:kworker.0 Request processed in 10429us (11443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778415.037203:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789778415.037433:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314947968:0@lo:400:kworker.0 00000100:00100000:1.0:1789778415.037505:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778415.037546:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789778415.037553:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314947840:0@lo:400:kworker.0 00000100:00100000:1.0:1789778415.037579:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778415.037614:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947840 00000100:00100000:1.0:1789778415.037621:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947840 00000100:00100000:1.0:1789778415.037685:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789778415.037695:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314947840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778415.037744:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314947840:12345-0@lo:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778415.037750:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789778415.037765:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778415.037776:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948096 00000100:00100000:1.0:1789778415.037779:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948096 00000100:00100000:1.0:1789778415.037806:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947968 00000100:00100000:1.0:1789778415.037809:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947968 00000100:00100000:1.0:1789778415.037824:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789778415.037830:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314948096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778415.037860:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314948096:12345-0@lo:400:kworker.0 Request processed in 30us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778415.037866:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789778415.037877:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789778415.037883:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314947968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778415.037908:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314947968:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778415.037914:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789778415.037927:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778415.037951:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314947840:0@lo:400:kworker.0 00000100:00100000:1.0:1789778415.037972:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314947968:0@lo:400:kworker.0 00000100:00100000:1.0:1789778415.038027:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778415.038052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778415.038356:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314947712 00000100:00100000:1.0:1789778415.038361:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314947712 00000100:00100000:1.0:1789778415.038388:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778415.038395:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314947712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789778415.038409:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778415.038443:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876718314947712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778415.038450:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789778415.038482:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778415.039248:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314948224:0@lo:400:kworker.0 00000100:00100000:2.0:1789778415.039295:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778415.039328:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948224 00000100:00100000:2.0:1789778415.039332:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948224 00000100:00100000:2.0:1789778415.039367:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789778415.039374:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314948224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778415.039409:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876718314948224:12345-0@lo:400:kworker.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778415.039437:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789778415.039453:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778415.039473:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876718314948224:0@lo:400:kworker.0 00000100:00100000:0.0:1789778415.046249:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314947584:0@lo:400:kworker.0 00000100:00100000:0.0:1789778415.046758:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314948096:0@lo:400:kworker.0 00000001:00100000:2.0:1789778415.130807:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 994018b1-ce46-430d-a31b-a5e08e23dff3 00000001:00080000:2.0:1789778415.130850:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1789778415.793295:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789778416.817383:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778417.059326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.059415:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083456 00000100:00100000:1.0:1789778417.059425:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083456 00000100:00100000:1.0:1789778417.059502:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1789778417.059512:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:13878:x1876718296083456:12345-192.168.201.45@tcp:41:lfs.0 00000004:00000024:1.0:1789778417.059554:0:16026:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789778417.059651:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:13878:x1876718296083456:12345-192.168.201.45@tcp:41:lfs.0 Request processed in 140us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.059659:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00080000:2.0:1789778417.059926:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778417.068501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.068594:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083584 00000100:00100000:1.0:1789778417.068605:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083584 00000100:00100000:1.0:1789778417.068694:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:1.0:1789778417.068705:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:994018b1-ce46-430d-a31b-a5e08e23dff3+6:13878:x1876718296083584:12345-192.168.201.45@tcp:13:lfs.0 00002000:00000024:1.0:1789778417.068749:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778417.068857:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:994018b1-ce46-430d-a31b-a5e08e23dff3+6:13878:x1876718296083584:12345-192.168.201.45@tcp:13:lfs.0 Request processed in 154us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.068865:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00080000:2.0:1789778417.069593:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778417.070747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.070821:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083712 00000100:00100000:1.0:1789778417.070831:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083712 00000100:00100000:1.0:1789778417.070887:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1789778417.070896:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:994018b1-ce46-430d-a31b-a5e08e23dff3+5:13878:x1876718296083712:12345-192.168.201.45@tcp:13:lfs.0 00002000:00000024:1.0:1789778417.070941:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778417.071023:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:994018b1-ce46-430d-a31b-a5e08e23dff3+5:13878:x1876718296083712:12345-192.168.201.45@tcp:13:lfs.0 Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.071031:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00080000:2.0:1789778417.071362:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789778417.377328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.377564:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083840 00000100:00100000:1.0:1789778417.377575:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083840 00000100:00100000:1.0:1789778417.377645:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:1.0:1789778417.377656:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+10:13911:x1876718296083840:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789778417.377674:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778417.377697:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d81f76c00/0x5a1e1c115744212a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7f7a expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778417.377728:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d81f76c00/0x5a1e1c115744212a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f7a expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778417.377741:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d81f76c00/0x5a1e1c115744212a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f7a expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778417.377752:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f76c00, rc 0) 00000100:00100000:1.0:1789778417.377817:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+11:13911:x1876718296083840:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 163us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.377838:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 92 00000100:00100000:0.0:1789778417.393621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.393835:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296083968 00000100:00100000:1.0:1789778417.393846:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296083968 00000100:00100000:1.0:1789778417.393908:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:1.0:1789778417.393918:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+11:13911:x1876718296083968:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789778417.394755:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+11:13911:x1876718296083968:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 833us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.394764:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 93 00000100:00100000:0.0:1789778417.435451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778417.435598:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084096 00000100:00100000:2.0:1789778417.435608:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084096 00000100:00100000:2.0:1789778417.435670:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:2.0:1789778417.435682:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+11:13911:x1876718296084096:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789778417.436129:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+11:13911:x1876718296084096:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 446us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778417.436407:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 94 00000100:00100000:2.0:1789778417.454001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778417.454108:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084224 00000100:00100000:0.0:1789778417.454118:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084224 00000100:00100000:0.0:1789778417.454181:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:0.0:1789778417.454192:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+11:13917:x1876718296084224:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789778417.454850:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+11:13917:x1876718296084224:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 658us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.454858:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 95 00000100:00100000:0.0:1789778417.487860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.488304:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084352 00000100:00100000:1.0:1789778417.488316:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084352 00000100:00100000:1.0:1789778417.488447:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:1.0:1789778417.488458:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+11:13917:x1876718296084352:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789778417.488805:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+11:13917:x1876718296084352:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 347us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.488814:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 96 00000100:00100000:1.0:1789778417.501492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778417.501814:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084480 00000100:00100000:0.0:1789778417.501826:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084480 00000100:00100000:0.0:1789778417.501888:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:0.0:1789778417.501909:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+11:13911:x1876718296084480:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789778417.501936:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778417.502333:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756c00/0x5a1e1c1157442131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7fa4 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.502370:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756c00/0x5a1e1c1157442131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fa4 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.502400:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756c00/0x5a1e1c1157442131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fa4 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.502409:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756c00, rc 0) 00000100:00100000:0.0:1789778417.502468:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+12:13911:x1876718296084480:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 571us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.502475:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 97 00000100:00100000:0.0:1789778417.518391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.521489:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084608 00000100:00100000:1.0:1789778417.521506:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084608 00000100:00100000:1.0:1789778417.521977:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:1.0:1789778417.521989:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf9ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+12:13911:x1876718296084608:12345-192.168.201.45@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789778417.522016:0:14402:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789778417.522049:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789778417.522054:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789778417.522095:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789778417.522099:0:14402:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789778417.528402:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf9ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+12:13911:x1876718296084608:12345-192.168.201.45@tcp:256:mount.lustre.0 Request processed in 6402us (10361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778417.528418:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 98 00000100:00100000:2.0:1789778417.533417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.534905:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084736 00000100:00100000:1.0:1789778417.534932:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084736 00000100:00100000:1.0:1789778417.535024:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:1.0:1789778417.535048:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+12:13911:x1876718296084736:12345-192.168.201.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789778417.535102:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778417.535120:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7fab expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778417.535148:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778417.535158:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778417.535166:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f76800, rc 0) 00000100:00100000:1.0:1789778417.535231:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+13:13911:x1876718296084736:12345-192.168.201.45@tcp:101:mount.lustre.0 Request processed in 197us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.535238:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 99 00000100:00100000:1.0:1789778417.540994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778417.541462:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084864 00000100:00100000:2.0:1789778417.541476:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084864 00000100:00100000:2.0:1789778417.541554:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1789778417.541583:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+13:13911:x1876718296084864:12345-192.168.201.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789778417.542481:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+13:13911:x1876718296084864:12345-192.168.201.45@tcp:501:mount.lustre.0 Request processed in 897us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778417.542491:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 100 00000100:00100000:2.0:1789778417.552394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778417.552536:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296084992 00000100:00100000:0.0:1789778417.552549:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296084992 00000100:00100000:0.0:1789778417.552610:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:0.0:1789778417.552620:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+13:13911:x1876718296084992:12345-192.168.201.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789778417.553675:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+13:13911:x1876718296084992:12345-192.168.201.45@tcp:503:mount.lustre.0 Request processed in 1050us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.553685:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 101 00000100:00100000:3.0:1789778417.566147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.568699:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296085120 00000100:00100000:1.0:1789778417.568717:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296085120 00000100:00100000:1.0:1789778417.568795:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:1.0:1789778417.569268:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+13:13922:x1876718296085120:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789778417.570254:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+13:13922:x1876718296085120:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 1445us (4113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.570265:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 102 00000100:00100000:1.0:1789778417.581799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778417.583864:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296085248 00000100:00100000:2.0:1789778417.583879:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296085248 00000100:00100000:2.0:1789778417.583961:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:2.0:1789778417.583972:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+13:13922:x1876718296085248:12345-192.168.201.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789778417.584279:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+13:13922:x1876718296085248:12345-192.168.201.45@tcp:502:llog_process_th.0 Request processed in 308us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778417.584288:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 103 00000100:00100000:3.0:1789778417.618363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778417.618400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778417.618435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778417.618458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778417.618491:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086016 00000100:00100000:3.0:1789778417.618499:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086016 00000100:00100000:3.0:1789778417.618545:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296085888 00000100:00100000:3.0:1789778417.618547:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296085888 00000100:00100000:3.0:1789778417.618561:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1789778417.618583:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2374:x1876718296086016:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778417.618618:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296085376 00000100:00100000:0.0:1789778417.618632:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296085376 00000100:00100000:0.0:1789778417.618661:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296085760 00000100:00100000:3.0:1789778417.618665:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2374:x1876718296086016:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.618666:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296085760 00000100:00100000:3.0:1789778417.618677:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:0.0:1789778417.618701:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1789778417.618704:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1789778417.618713:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2374:x1876718296085760:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778417.618717:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2374:x1876718296085888:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778417.618748:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2374:x1876718296085888:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778417.618753:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:0.0:1789778417.618759:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2374:x1876718296085760:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 48us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.618767:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1789778417.618784:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1789778417.618796:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2371:x1876718296085376:12345-192.168.201.45@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789778417.618831:0:14409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1@192.168.201.45@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1789778417.618865:0:14409:0:(genops.c:1385:class_connect()) connect: client 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1, cookie 0x5a1e1c115744213f 00000004:00100000:0.0:1789778417.618893:0:14409:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789778417.619017:0:14409:0:(import.c:65:import_set_state_nolock()) ffff9b3eb7017800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778417.619060:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2371:x1876718296085376:12345-192.168.201.45@tcp:38:mount.lustre.0 Request processed in 262us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.619098:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1789778417.647008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.647049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.647101:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296085632 00000100:00100000:1.0:1789778417.647111:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296085632 00000100:00100000:1.0:1789778417.647166:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296085504 00000100:00100000:1.0:1789778417.647169:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296085504 00000100:00100000:1.0:1789778417.647189:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1789778417.647198:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+7:13911:x1876718296085632:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789778417.647227:0:14409:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789778417.647288:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+7:13911:x1876718296085632:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.647296:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1789778417.647311:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778417.647317:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:0:x1876718296085504:12345-192.168.201.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789778417.647328:0:14409:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789778417.647348:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:0:x1876718296085504:12345-192.168.201.45@tcp:41:mount.lustre.0 Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778417.647354:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00080000:1.0:1789778417.647390:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778417.651954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778417.652106:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086144 00000100:00100000:3.0:1789778417.652118:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086144 00000100:00100000:3.0:1789778417.652213:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:3.0:1789778417.652224:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:13911:x1876718296086144:12345-192.168.201.45@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789778417.652310:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:13911:x1876718296086144:12345-192.168.201.45@tcp:40:mount.lustre.0 Request processed in 89us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778417.652318:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1789778417.660974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.661007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778417.661037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778417.661192:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086272 00000100:00100000:0.0:1789778417.661202:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086272 00000100:00100000:0.0:1789778417.661235:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086400 00000100:00100000:0.0:1789778417.661237:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086400 00000100:00100000:0.0:1789778417.661251:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1789778417.661259:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1876718296086272:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789778417.661287:0:15095:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1@192.168.201.45@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1789778417.661316:0:15095:0:(genops.c:1385:class_connect()) connect: client 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1, cookie 0x5a1e1c1157442146 00002000:00100000:0.0:1789778417.661328:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1/ffff9b3eb7014000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789778417.661338:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789778417.661564:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789778417.661593:0:15095:0:(import.c:65:import_set_state_nolock()) ffff9b3e84ef2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778417.661666:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2371:x1876718296086272:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 406us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.661674:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:0.0:1789778417.661697:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1789778417.661702:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1876718296086400:12345-192.168.201.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789778417.661732:0:15095:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1@192.168.201.45@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1789778417.661749:0:15095:0:(genops.c:1385:class_connect()) connect: client 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1, cookie 0x5a1e1c115744214d 00002000:00100000:0.0:1789778417.661754:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1/ffff9b3e84ef0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789778417.661760:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789778417.661889:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789778417.661906:0:15095:0:(import.c:65:import_set_state_nolock()) ffff9b3e84ef6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789778417.661927:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2371:x1876718296086400:12345-192.168.201.45@tcp:8:mount.lustre.0 Request processed in 223us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.661934:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:3.0:1789778417.663652:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086528 00000100:00100000:3.0:1789778417.663665:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086528 00000100:00100000:3.0:1789778417.663715:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:3.0:1789778417.663724:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:13911:x1876718296086528:12345-192.168.201.45@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789778417.663791:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789778417.663866:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:13911:x1876718296086528:12345-192.168.201.45@tcp:33:mount.lustre.0 Request processed in 143us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778417.663873:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000001:00100000:1.0:1789778417.672721:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 994018b1-ce46-430d-a31b-a5e08e23dff3 00010000:00010000:3.0:1789778417.841406:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778417.985305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778417.985499:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086656 00000100:00100000:0.0:1789778417.985509:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086656 00000100:00100000:0.0:1789778417.985585:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:0.0:1789778417.985593:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:13943:x1876718296086656:12345-192.168.201.45@tcp:101:mkdir.0 00010000:00010000:0.0:1789778417.985610:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778417.985642:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756200/0x5a1e1c1157442154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7fd5 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.985695:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.985705:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.985715:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778417.985749:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789778417.985764:0:14408:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778417.985789:0:14408:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.985913:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756200/0x5a1e1c1157442154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 8 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.985931:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 7 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778417.985937:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:0.0:1789778417.985939:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778417.985942:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756a00, rc 0) 00000100:00100000:0.0:1789778417.986419:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+7:13943:x1876718296086656:12345-192.168.201.45@tcp:101:mkdir.0 Request processed in 824us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778417.986427:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00010000:00010000:2.0:1789778418.865636:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778419.634658:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314948352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778419.634736:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778419.634914:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948352 00000100:00100000:2.0:1789778419.634923:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948352 00000100:00100000:2.0:1789778419.635003:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789778419.635015:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314948352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789778419.635050:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778419.635126:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314948352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778419.635134:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789778419.635182:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314948352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789778419.635452:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789778419.719287:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1 00000001:00100000:0.0:1789778419.719309:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 994018b1-ce46-430d-a31b-a5e08e23dff3 00010000:00010000:0.0:1789778419.893447:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778420.162062:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314948608:0@lo:400:kworker.0 00000100:00100000:2.0:1789778420.162131:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314948480:0@lo:400:kworker.0 00000100:00100000:2.0:1789778420.162211:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778420.162265:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314948992:0@lo:400:kworker.0 00000100:00100000:2.0:1789778420.162304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778420.162330:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778420.162336:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314948864:0@lo:400:kworker.0 00000100:00100000:2.0:1789778420.162357:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778420.162569:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778420.162613:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314949120:0@lo:400:kworker.0 00000100:00100000:0.0:1789778420.162634:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778420.162653:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789778420.162660:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314948736:0@lo:400:kworker.0 00000100:00100000:0.0:1789778420.162681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778420.162697:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314949248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778420.162729:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778420.162757:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948608 00000100:00100000:0.0:1789778420.162764:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948608 00000100:00100000:0.0:1789778420.162806:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948736 00000100:00100000:0.0:1789778420.162809:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948736 00000100:00100000:0.0:1789778420.162838:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789778420.162846:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314948608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778420.162896:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314948608:12345-0@lo:400:kworker.0 Request processed in 50us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778420.162903:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789778420.163927:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778420.163943:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314948736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778420.163996:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314948736:12345-0@lo:400:kworker.0 Request processed in 59us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778420.164003:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778420.164031:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314949248 00000100:00100000:2.0:1789778420.164036:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314949248 00000100:00100000:2.0:1789778420.164081:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789778420.164087:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314949248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778420.164113:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789778420.164143:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314949248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778420.164148:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789778420.164447:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789778420.164464:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314948736:0@lo:400:kworker.0 00000100:00100000:0.0:1789778420.164479:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314949248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778420.164488:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314948608:0@lo:400:kworker.0 00000100:00100000:3.0:1789778420.178458:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948992 00000100:00100000:3.0:1789778420.178475:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948992 00000100:00100000:3.0:1789778420.178537:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948864 00000100:00100000:3.0:1789778420.178541:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948864 00000100:00100000:3.0:1789778420.178571:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314949120 00000100:00100000:3.0:1789778420.178606:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314949120 00000100:00100000:3.0:1789778420.178633:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789778420.178644:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314948992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778420.178747:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314948992:12345-0@lo:400:kworker.0 Request processed in 105us (16442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778420.178755:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789778420.178772:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789778420.178778:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb94b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314948864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778420.178807:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb94b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314948864:12345-0@lo:400:kworker.0 Request processed in 29us (16448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778420.178813:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789778420.178823:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789778420.178829:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314949120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778420.178862:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314949120:12345-0@lo:400:kworker.0 Request processed in 34us (16227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778420.178868:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789778420.187041:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789778420.187051:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778420.189054:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314948864:0@lo:400:kworker.0 00000100:00100000:3.0:1789778420.189099:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314948992:0@lo:400:kworker.0 00000100:00100000:3.0:1789778420.189143:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314949120:0@lo:400:kworker.0 00000100:00100000:0.0:1789778420.200893:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314948480 00000100:00100000:0.0:1789778420.200979:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314948480 00000100:00100000:0.0:1789778420.201041:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789778420.201052:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3311:x1876718314948480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778420.201170:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3311:x1876718314948480:12345-0@lo:400:kworker.0 Request processed in 120us (38959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778420.201177:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789778420.201786:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314948480:0@lo:400:kworker.0 00000001:00100000:2.0:1789778420.273691:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1 00010000:00010000:3.0:1789778420.917358:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789778421.235439:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789778421.781040:0:16372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789778421.938683:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789778422.772447:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1 00010000:00010000:0.0:1789778422.964160:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778423.050701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778423.050761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778423.050799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778423.050818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778423.050848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778423.050867:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778423.050889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778423.050943:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086784 00000100:00100000:0.0:1789778423.050953:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086784 00000100:00100000:0.0:1789778423.051010:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:0.0:1789778423.051027:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+13:2372:x1876718296086784:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778423.051256:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+13:2372:x1876718296086784:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 229us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778423.051265:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 105 00000100:00100000:0.0:1789778423.051299:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087040 00000100:00100000:0.0:1789778423.051304:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087040 00000100:00100000:0.0:1789778423.051456:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087552 00000100:00100000:0.0:1789778423.051459:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087552 00000100:00100000:0.0:1789778423.051473:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087168 00000100:00100000:0.0:1789778423.051475:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087168 00000100:00100000:0.0:1789778423.051486:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087424 00000100:00100000:0.0:1789778423.051489:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087424 00000100:00100000:0.0:1789778423.051504:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1789778423.051512:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2372:x1876718296087040:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778423.051557:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2372:x1876718296087040:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 46us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778423.051564:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1789778423.051578:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1789778423.051584:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296087552:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778423.051607:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296087552:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778423.051614:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:0.0:1789778423.051626:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778423.051633:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2372:x1876718296087168:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778423.051658:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2372:x1876718296087168:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778423.051672:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778423.051685:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1789778423.051692:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296087424:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:0.0:1789778423.051717:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296087424:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 26us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778423.051723:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:3.0:1789778423.051806:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087296 00000100:00100000:3.0:1789778423.051812:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087296 00000100:00100000:3.0:1789778423.051850:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296086912 00000100:00100000:3.0:1789778423.051853:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296086912 00000100:00100000:3.0:1789778423.051881:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1789778423.051889:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2372:x1876718296087296:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778423.051919:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2372:x1876718296087296:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 31us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778423.051925:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1789778423.051939:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1789778423.051945:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2372:x1876718296086912:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:3.0:1789778423.051969:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2372:x1876718296086912:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778423.051975:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00080000:3.0:1789778423.052176:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789778423.052182:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778423.052184:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789778423.985272:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778424.753409:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314949376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778424.753484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778424.753630:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314949376 00000100:00100000:0.0:1789778424.753640:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314949376 00000100:00100000:0.0:1789778424.753728:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789778424.753738:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314949376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789778424.753782:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789778424.762120:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789778424.762452:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314949376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8708us (8960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778424.762466:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789778424.765719:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314949376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789778425.009891:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778425.266376:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789778425.266401:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314949504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789778425.266497:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778425.266572:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314949504 00000100:00100000:3.0:1789778425.266580:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314949504 00000100:00100000:3.0:1789778425.266636:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789778425.266648:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314949504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789778425.266683:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778425.266731:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314949504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778425.266739:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789778425.266760:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789778425.266795:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314949504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789778425.271777:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314949632:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.271867:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778425.271903:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314950144:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.271930:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778425.271956:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789778425.271976:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314949760:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778425.272030:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314950016:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272053:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778425.272095:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789778425.272101:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314949888:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778425.272153:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314949632 00000100:00100000:2.0:1789778425.272161:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314949632 00000100:00100000:2.0:1789778425.272207:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789778425.272216:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3312:x1876718314949632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272281:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3312:x1876718314949632:12345-0@lo:400:kworker.0 Request processed in 65us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778425.272289:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789778425.272321:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314950144 00000100:00100000:2.0:1789778425.272325:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314950144 00000100:00100000:2.0:1789778425.272358:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314950016 00000100:00100000:2.0:1789778425.272360:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314950016 00000100:00100000:2.0:1789778425.272376:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314949888 00000100:00100000:2.0:1789778425.272379:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314949888 00000100:00100000:2.0:1789778425.272390:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789778425.272396:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314950144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272428:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876718314950144:12345-0@lo:400:kworker.0 Request processed in 33us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778425.272434:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789778425.272446:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789778425.272451:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314950016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272506:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876718314950016:12345-0@lo:400:kworker.0 Request processed in 55us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778425.272512:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789778425.272524:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789778425.272530:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314949888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272555:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876718314949888:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778425.272561:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789778425.272580:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314949760 00000100:00100000:2.0:1789778425.272583:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314949760 00000100:00100000:2.0:1789778425.272609:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789778425.272615:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314949760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272644:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314949760:12345-0@lo:400:kworker.0 Request processed in 29us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778425.272649:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789778425.272692:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314949760:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272700:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb94b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3312:1876718314949632:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272708:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876718314950144:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272741:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876718314949888:0@lo:400:kworker.0 00000100:00100000:2.0:1789778425.272749:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876718314950016:0@lo:400:kworker.0 00000100:00080000:2.0:1789778425.272766:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789778426.034396:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789778426.112422:0:16520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3a576d20 20000000:00000080:2.0:1789778426.112439:0:16520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3d81228800 uarg=0000000000000000 20000000:01000000:2.0:1789778426.112488:0:16520:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789778426.112665:0:16520:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789778426.112670:0:16520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789778426.113840:0:16521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789778426.114319:0:16520:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789778426.119728:0:16520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789778426.119907:0:16520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.119928:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.120007:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.120015:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.120025:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.120048:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.120054:0:16520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.122403:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.122424:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 12 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.122440:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950272:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778426.122606:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.122616:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 12 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.122625:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950400:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778426.122658:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.122667:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 18 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.122677:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950528:0@lo:104: 00000100:00100000:3.0:1789778426.122716:0:16520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778426.122870:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.122879:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 18 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.122887:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950656:0@lo:104: 00000100:00100000:3.0:1789778426.122909:0:16520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789778426.122945:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.122953:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 18 pid: 14401 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.122960:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950784:0@lo:104: 00000100:00100000:3.0:1789778426.122986:0:16520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778426.122996:0:16520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e82f679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778426.123189:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789778426.123204:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314950528 00000100:00100000:2.0:1789778426.123211:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314950528 00000100:00100000:2.0:1789778426.123254:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314950656 00000100:00100000:2.0:1789778426.123257:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314950656 00000100:00100000:2.0:1789778426.123267:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314950784 00000100:00100000:2.0:1789778426.123270:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314950784 00000100:00100000:2.0:1789778426.123282:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778426.123291:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+5:16520:x1876718314950528:12345-0@lo:104: 00010000:00010000:2.0:1789778426.123303:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123359:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789778426.123365:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+5:16520:x1876718314950528:12345-0@lo:104: Request processed in 76us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778426.123372:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778426.123388:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789778426.123394:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+4:16520:x1876718314950656:12345-0@lo:104: 00010000:00010000:2.0:1789778426.123401:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123434:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789778426.123440:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+4:16520:x1876718314950656:12345-0@lo:104: Request processed in 46us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778426.123445:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789778426.123464:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789778426.123482:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:16520:x1876718314950784:12345-0@lo:104: 00010000:00010000:2.0:1789778426.123489:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123531:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789778426.123536:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+3:16520:x1876718314950784:12345-0@lo:104: Request processed in 67us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778426.123541:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789778426.123575:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789778426.123581:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123588:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657e00 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778426.123592:0:16030:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123600:0:16030:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778426.123607:0:16030:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778426.123613:0:16030:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789778426.123639:0:16030:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123644:0:16030:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778426.123661:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123677:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e81657e00/0x5a1e1c1157441fda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441fe1 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123690:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789778426.123693:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123698:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e833f8800 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778426.123701:0:16030:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123708:0:16030:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778426.123714:0:16030:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778426.123719:0:16030:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789778426.123731:0:16030:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123736:0:16030:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778426.123751:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123756:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e833f8800/0x5a1e1c1157441e9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441ea6 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.123764:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778426.124143:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.124150:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757200 already unused, calling callback (ffffffffc1b43c20) 10000000:00010000:2.0:1789778426.124153:0:16030:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.124160:0:16030:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789778426.124166:0:16030:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789778426.124172:0:16030:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789778426.124186:0:16030:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.124192:0:16030:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789778426.124198:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.124205:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.145@tcp lock: ffff9b3e95757200/0x5a1e1c1157441e52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5a1e1c1157441e59 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.124218:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778426.124220:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778426.124222:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778426.124229:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778426.124234:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789778426.124255:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3313:1876718314950912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778426.124290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778426.124344:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3310:1876718314951040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778426.124367:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778426.124385:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789778426.124391:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3310:1876718314951168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789778426.124411:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778426.124441:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314950912 00000100:00100000:2.0:1789778426.124447:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314950912 00010000:00010000:2.0:1789778426.124467:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 19 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778426.124493:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951040 00000100:00100000:2.0:1789778426.124495:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951040 00010000:00010000:2.0:1789778426.124724:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 20 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778426.124738:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951168 00000100:00100000:2.0:1789778426.124741:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951168 00010000:00010000:2.0:1789778426.124750:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 21 pid: 14401 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778426.124763:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789778426.124834:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+21:3313:x1876718314950912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778426.124846:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778426.124851:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 21 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.124859:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 21 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.124875:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778426.124915:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+21:3313:x1876718314950912:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778426.124922:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789778426.126127:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e95757800/0x5a1e1c1157441fe1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157441fda expref: 20 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.126144:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950528:0@lo:104: 00000100:00100000:3.0:1789778426.126157:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950656:0@lo:104: 00000100:00100000:3.0:1789778426.126167:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950784:0@lo:104: 00000100:00100000:2.0:1789778426.126240:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789778426.126256:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3310:x1876718314951040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789778426.126269:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778426.126274:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 19 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.126285:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 19 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.126299:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3ebf44d800/0x5a1e1c1157441ea6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157441e9f expref: 19 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778426.126310:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778426.126362:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:3310:x1876718314951040:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778426.132803:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789778426.132831:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95793850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:3310:x1876718314951168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789778426.132856:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778426.132866:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 18 pid: 14401 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.132901:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 18 pid: 14401 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.132920:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3d82320800/0x5a1e1c1157441e59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5a1e1c1157441e52 expref: 18 pid: 14401 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.132952:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789778426.133026:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95793850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:3310:x1876718314951168:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (8613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778426.133034:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789778426.133146:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3313:1876718314950912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789778426.133189:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3310:1876718314951168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789778426.133198:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3310:1876718314951040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789778426.133657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778426.133744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778426.133772:0:14393:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789778426.133780:0:14393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789778426.133896:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087680 00000100:00100000:1.0:1789778426.133904:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087680 00010000:00010000:1.0:1789778426.133928:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 13 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778426.134042:0:14394:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789778426.134050:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087808 00000100:00100000:0.0:1789778426.134054:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087808 00010000:00010000:0.0:1789778426.134090:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 14 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778426.134108:0:14394:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789778426.134117:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:0.0:1789778426.134125:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7eb169-d267-4201-9b8c-0564b642e934+14:2375:x1876718296087808:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778426.134137:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778426.134142:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 14 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778426.134161:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 14 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778426.134177:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778426.134233:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f7eb169-d267-4201-9b8c-0564b642e934+14:2375:x1876718296087808:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 108us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778426.134241:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1789778426.134401:0:14393:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789778426.134409:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:1.0:1789778426.134416:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3d822f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7eb169-d267-4201-9b8c-0564b642e934+13:2375:x1876718296087680:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778426.134424:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778426.134429:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 13 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134438:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 13 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134450:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134458:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134496:0:14393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134503:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134510:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134518:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134524:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150fc00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778426.134528:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134536:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134544:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778426.134554:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778426.134583:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3d822f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f7eb169-d267-4201-9b8c-0564b642e934+13:2375:x1876718296087680:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 167us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778426.134590:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00010000:00010000:3.0:1789778426.136824:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3d81f76800/0x5a1e1c1157442138 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fab expref: 12 pid: 14403 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.136845:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950272:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778426.136859:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e81656200/0x5a1e1c1157442100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f49 expref: 11 pid: 14402 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778426.136869:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1876718314950400:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778426.136903:0:16520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.136913:0:16520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.137284:0:16520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778426.137292:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c1157442162 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778426.138870:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789778427.058510:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789778427.889324:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789778427.889333:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3eabbab000 from 10 10000000:01000000:2.0:1789778427.889338:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789778427.889382:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657a00/0x5a1e1c1157442169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778427.889393:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e81657a00/0x5a1e1c1157442169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778427.889417:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e81657a00/0x5a1e1c1157442169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778427.889569:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789778427.889640:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778427.889695:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778427.891348:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951296 00000100:00100000:1.0:1789778427.891360:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951296 00000100:00100000:1.0:1789778427.891425:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789778427.891435:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+16:14405:x1876718314951296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789778427.891598:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778427.891617:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3d81f76400/0x5a1e1c1157442170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157442169 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778427.891643:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3d81f76400/0x5a1e1c1157442170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157442169 expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778427.891654:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3d81f76400/0x5a1e1c1157442170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157442169 expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778427.891663:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f76400, rc 0) 00000100:00100000:1.0:1789778427.891735:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:14405:x1876718314951296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778427.891751:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789778427.891891:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789778427.891909:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e81657a00/0x5a1e1c1157442169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157442170 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778427.891920:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e81657a00/0x5a1e1c1157442169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c1157442170 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778427.891995:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778427.892027:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778427.892107:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778427.892954:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951424 00000100:00100000:1.0:1789778427.892961:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951424 00000100:00100000:1.0:1789778427.893003:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789778427.893012:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:14405:x1876718314951424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778427.893831:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778427.893879:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789778427.893925:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778427.893956:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ebfb63f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778427.893991:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:14405:x1876718314951424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 726us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778427.894000:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789778427.894026:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951552 00000100:00100000:1.0:1789778427.894031:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951552 00000100:00100000:1.0:1789778427.894124:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789778427.894130:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:14405:x1876718314951552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789778427.894286:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:14405:x1876718314951552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778427.894301:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789778427.898356:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789778427.910000:0:16577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789778427.910782:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789778427.910810:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789778427.910823:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e81657a00/0x5a1e1c1157442169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157442170 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778427.910836:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e81657a00/0x5a1e1c1157442169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c1157442170 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789778427.910847:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789778427.910849:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ea019f800 from 10 10000000:01000000:1.0:1789778427.910852:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789778427.910891:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d81f76e00/0x5a1e1c1157442177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778427.910899:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3d81f76e00/0x5a1e1c1157442177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778427.910909:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3d81f76e00/0x5a1e1c1157442177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778427.910934:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789778427.910997:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778427.911043:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d6d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789778427.911316:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951680 00000100:00100000:0.0:1789778427.911323:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951680 00000100:00100000:0.0:1789778427.911372:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789778427.911382:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+17:14405:x1876718314951680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789778427.911407:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778427.911421:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e95756200/0x5a1e1c115744217e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157442177 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778427.911461:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e95756200/0x5a1e1c115744217e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157442177 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778427.911474:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e95756200/0x5a1e1c115744217e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157442177 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778427.911483:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756200, rc 0) 00000100:00100000:0.0:1789778427.911521:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:14405:x1876718314951680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778427.911528:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789778427.911706:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789778427.911719:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3d81f76e00/0x5a1e1c1157442177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c115744217e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778427.911728:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3d81f76e00/0x5a1e1c1157442177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c115744217e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778427.911805:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778427.911831:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778427.911855:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d6d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789778427.912001:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951808 00000100:00100000:0.0:1789778427.912006:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951808 00000100:00100000:0.0:1789778427.912042:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789778427.912048:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:14405:x1876718314951808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789778427.912624:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:14405:x1876718314951808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 574us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778427.912632:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789778427.912767:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789778427.912797:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789778427.912834:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778427.912866:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d6d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789778427.912947:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314951936 00000100:00100000:0.0:1789778427.912952:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314951936 00000100:00100000:0.0:1789778427.912983:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789778427.912989:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:14405:x1876718314951936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778427.913362:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:14405:x1876718314951936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778427.913369:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789778427.913563:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec16f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314951936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789778427.915620:0:16578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789778427.916003:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789778427.916026:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789778427.916036:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3d81f76e00/0x5a1e1c1157442177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c115744217e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778427.916048:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3d81f76e00/0x5a1e1c1157442177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c115744217e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789778427.916059:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789778427.916105:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b3ec17e1800 from 10 10000000:01000000:0.0:1789778427.916109:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789778427.916143:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157442185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778427.916152:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157442185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778427.916180:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157442185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778427.916255:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec178b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314952064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789778427.916324:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778427.916367:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3ec17b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789778427.916689:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952064 00000100:00100000:3.0:1789778427.916700:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952064 00000100:00100000:3.0:1789778427.916761:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789778427.916772:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+18:14405:x1876718314952064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778427.916786:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778427.916801:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c115744218c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5a1e1c1157442185 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778427.916824:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c115744218c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5a1e1c1157442185 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778427.916835:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150fc00/0x5a1e1c115744218c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5a1e1c1157442185 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778427.916843:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150fc00, rc 0) 00000100:00100000:3.0:1789778427.916883:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314952064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778427.916890:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789778427.916931:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec178b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314952064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778427.916946:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157442185 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c115744218c expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778427.916966:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157442185 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5a1e1c115744218c expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778427.917021:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314952192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778427.917047:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778427.917062:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e838a90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778427.917107:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952192 00000100:00100000:3.0:1789778427.917110:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952192 00000100:00100000:3.0:1789778427.917131:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789778427.917137:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314952192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778427.917581:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314952192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778427.917589:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789778427.917618:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314952192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778427.917647:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314952320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778427.917687:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778427.917701:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e838a90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778427.917713:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952320 00000100:00100000:3.0:1789778427.917716:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952320 00000100:00100000:3.0:1789778427.917735:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789778427.917741:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314952320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789778427.917878:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:14405:x1876718314952320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778427.917885:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789778427.917922:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:14405:1876718314952320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789778427.919591:0:16579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789778427.919821:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789778427.919840:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789778427.919851:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157442185 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c115744218c expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778427.919862:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.145@tcp lock: ffff9b3e95756400/0x5a1e1c1157442185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5a1e1c115744218c expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778428.082773:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778428.107179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778428.107551:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296087936 00000100:00100000:3.0:1789778428.107562:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296087936 00000100:00100000:3.0:1789778428.107624:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:3.0:1789778428.107635:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+11:13796:x1876718296087936:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778428.107652:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778428.107670:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157442193 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7fdc expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778428.107698:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157442193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fdc expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778428.107710:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150f400/0x5a1e1c1157442193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fdc expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778428.107719:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f400, rc 0) 00000100:00100000:3.0:1789778428.107784:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+12:13796:x1876718296087936:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 152us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778428.119080:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 116 00000100:00100000:1.0:1789778428.119327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778428.119398:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088064 00000100:00100000:3.0:1789778428.119410:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088064 00000100:00100000:3.0:1789778428.119465:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:3.0:1789778428.119475:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+12:13796:x1876718296088064:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789778428.119791:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+12:13796:x1876718296088064:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 316us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778428.119799:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 117 00000100:00100000:0.0:1789778428.129273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778428.131262:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088192 00000100:00100000:0.0:1789778428.131278:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088192 00000100:00100000:0.0:1789778428.131340:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:0.0:1789778428.131351:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+12:13796:x1876718296088192:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789778428.131577:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+12:13796:x1876718296088192:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 227us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778428.131586:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 118 00000100:00100000:1.0:1789778428.148515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778428.148724:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088320 00000100:00100000:3.0:1789778428.148745:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088320 00000100:00100000:3.0:1789778428.148808:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:3.0:1789778428.148819:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+12:13796:x1876718296088320:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789778428.148836:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778428.148853:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3e8150e400/0x5a1e1c115744219a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7fe3 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778428.148882:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3e8150e400/0x5a1e1c115744219a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fe3 expref: 13 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778428.148893:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3e8150e400/0x5a1e1c115744219a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fe3 expref: 13 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778428.148901:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150e400, rc 0) 00000100:00100000:3.0:1789778428.148954:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f7eb169-d267-4201-9b8c-0564b642e934+13:13796:x1876718296088320:12345-192.168.201.45@tcp:101:ll_cfg_requeue.0 Request processed in 137us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778428.148961:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 119 00000100:00100000:0.0:1789778428.154710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778428.154827:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088448 00000100:00100000:2.0:1789778428.154838:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088448 00000100:00100000:2.0:1789778428.154898:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:2.0:1789778428.154909:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+13:13796:x1876718296088448:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789778428.155244:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+13:13796:x1876718296088448:12345-192.168.201.45@tcp:501:ll_cfg_requeue.0 Request processed in 337us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778428.155259:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 120 00000100:00100000:3.0:1789778428.158960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778428.159046:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088576 00000100:00100000:1.0:1789778428.159057:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088576 00000100:00100000:1.0:1789778428.159277:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:1.0:1789778428.159288:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+13:13796:x1876718296088576:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789778428.159511:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f7eb169-d267-4201-9b8c-0564b642e934+13:13796:x1876718296088576:12345-192.168.201.45@tcp:503:ll_cfg_requeue.0 Request processed in 224us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778428.159519:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 121 00000100:00100000:0.0:1789778428.171839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778428.171879:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778428.171914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778428.171941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778428.171955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778428.171973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778428.172051:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088960 00000100:00100000:1.0:1789778428.172061:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088960 00000100:00080000:0.0:1789778428.172296:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778428.172342:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296089216 00000100:00100000:1.0:1789778428.172349:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296089216 00000100:00100000:1.0:1789778428.172384:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088832 00000100:00100000:1.0:1789778428.172394:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088832 00000100:00100000:1.0:1789778428.172409:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296089344 00000100:00100000:1.0:1789778428.172412:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296089344 00000100:00100000:1.0:1789778428.172442:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1789778428.172461:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2373:x1876718296088960:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778428.172583:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2373:x1876718296088960:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 129us (702us total) trans 0 rc 0/0 00000100:00080000:0.0:1789778428.172613:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789778428.172616:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789778428.172646:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:1.0:1789778428.172664:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1789778428.172672:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2373:x1876718296089216:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778428.172699:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2373:x1876718296089216:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778428.172705:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1789778428.172718:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778428.172723:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2373:x1876718296088832:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778428.172745:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2373:x1876718296088832:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 21us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778428.172750:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778428.172760:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:1.0:1789778428.172765:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2373:x1876718296089344:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:1.0:1789778428.172787:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2373:x1876718296089344:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 22us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778428.172793:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1789778428.173105:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296088704 00000100:00100000:2.0:1789778428.173110:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296088704 00000100:00100000:2.0:1789778428.173149:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296089088 00000100:00100000:2.0:1789778428.173153:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296089088 00000100:00100000:2.0:1789778428.173188:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1789778428.173195:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2373:x1876718296088704:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778428.173235:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2373:x1876718296088704:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 41us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778428.173241:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1789778428.173255:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:2.0:1789778428.173261:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2373:x1876718296089088:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778428.173285:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2373:x1876718296089088:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 24us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778428.173290:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00080000:0.0:1789778428.173490:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789778429.110641:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778429.874290:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778429.874369:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314952448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778429.874527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778429.874760:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952448 00000100:00100000:1.0:1789778429.874770:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952448 00000100:00100000:1.0:1789778429.874842:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789778429.874852:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314952448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789778429.874892:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778429.874941:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314952448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778429.874949:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789778429.875012:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314952448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789778429.875142:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789778430.131085:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789778430.385326:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778430.385353:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314952576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778430.385451:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789778430.385680:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952576 00000100:00100000:3.0:1789778430.385690:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952576 00000100:00100000:3.0:1789778430.385764:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789778430.385774:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314952576:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789778430.385891:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789778430.385961:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789778430.386032:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1789180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314952576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778430.386039:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789778430.386131:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314952576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789778430.388662:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314952960:0@lo:400:kworker.0 00000100:00100000:1.0:1789778430.388741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778430.388785:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789778430.388792:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314953088:0@lo:400:kworker.0 00000100:00100000:1.0:1789778430.388943:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778430.388977:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952960 00000100:00100000:1.0:1789778430.388985:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952960 00000100:00100000:1.0:1789778430.389024:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314953088 00000100:00100000:1.0:1789778430.389028:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314953088 00000100:00100000:1.0:1789778430.389058:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778430.389096:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314952960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778430.389146:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314952960:12345-0@lo:400:kworker.0 Request processed in 81us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778430.389153:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789778430.389170:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789778430.389176:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314953088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778430.389202:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314953088:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778430.389214:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789778430.389324:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778430.389357:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314953088:0@lo:400:kworker.0 00000100:00100000:1.0:1789778430.389367:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314952960:0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.389449:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314952832:0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.389484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778430.389512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789778430.389517:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314952704:0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.389545:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778430.389571:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314953216:0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.389592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778430.389618:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952704 00000100:00100000:0.0:1789778430.389621:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952704 00000100:00100000:0.0:1789778430.389646:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789778430.389653:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3311:x1876718314952704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.389689:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3311:x1876718314952704:12345-0@lo:400:kworker.0 Request processed in 35us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778430.389706:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789778430.389748:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3311:1876718314952704:0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.389763:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314953216 00000100:00100000:0.0:1789778430.389766:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314953216 00000100:00100000:0.0:1789778430.389794:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789778430.389799:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314953216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.389944:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec1788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876718314953216:12345-0@lo:400:kworker.0 Request processed in 145us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778430.389951:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789778430.389967:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789778430.389984:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876718314953216:0@lo:400:kworker.0 00000100:00100000:1.0:1789778430.390045:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314952832 00000100:00100000:1.0:1789778430.390049:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314952832 00000100:00100000:1.0:1789778430.390104:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789778430.390111:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314952832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778430.390150:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314952832:12345-0@lo:400:kworker.0 Request processed in 39us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778430.390155:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789778430.390182:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314952832:0@lo:400:kworker.0 00000100:00100000:0.0:1789778430.648050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778430.648938:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296089472 00000100:00100000:1.0:1789778430.648952:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296089472 00000100:00100000:1.0:1789778430.649061:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:1.0:1789778430.649106:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec178b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+6:14454:x1876718296089472:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778430.649128:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778430.649148:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77600/0x5a1e1c11574421a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7fea expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.649216:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.649241:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.649285:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.649302:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.649309:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.649316:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789778430.649586:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789778430.650127:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76200/0x5a1e1c11574421b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650135:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76200/0x5a1e1c11574421b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650140:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76200/0x5a1e1c11574421b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778430.650164:0:16026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789778430.650167:0:16026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778430.650202:0:16026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76200/0x5a1e1c11574421b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650214:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650565:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650586:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650592:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f76600 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778430.650597:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650606:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650620:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:1.0:1789778430.650624:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778430.650629:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650635:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c11574421a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650653:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650660:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650884:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650892:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f77400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778430.650895:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650913:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650922:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b3e84f95c00) 00010000:00010000:1.0:1789778430.650924:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778430.650928:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650933:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c11574421af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650984:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77600/0x5a1e1c11574421a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fea expref: 8 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.650998:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76200/0x5a1e1c11574421b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fea expref: 7 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778430.651005:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3e84f95300) 00010000:00010000:1.0:1789778430.651008:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789778430.651009:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f76200, rc 0) 00000100:00100000:1.0:1789778430.651181:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec178b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:14454:x1876718296089472:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 2077us (3139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778430.651189:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:2.0:1789778430.654178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778430.654493:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296089728 00000100:00100000:0.0:1789778430.654504:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296089728 00000100:00100000:0.0:1789778430.654602:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:0.0:1789778430.654612:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+7:14454:x1876718296089728:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778430.654633:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778430.654652:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574421bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ff1 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.654759:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.654774:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.654787:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.654971:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.654979:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.654985:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.658335:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574421d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.658362:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574421d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.658375:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574421d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778430.658399:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789778430.659478:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659492:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659499:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659505:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778430.659511:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659534:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659548:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3e84f95300) 00010000:00010000:0.0:1789778430.659551:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778430.659556:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659562:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574421c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659577:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659583:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659589:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659594:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778430.659596:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659602:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659610:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778430.659612:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778430.659615:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.659631:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c11574421cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.661199:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756600/0x5a1e1c11574421bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ff1 expref: 10 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.661222:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757800/0x5a1e1c11574421d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ff1 expref: 9 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.661231:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:0.0:1789778430.661233:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778430.661236:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757800, rc 0) 00000100:00100000:0.0:1789778430.661499:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14454:x1876718296089728:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 6885us (7327us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789778430.661510:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1789778430.669648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778430.670216:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296089856 00000100:00100000:2.0:1789778430.670237:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296089856 00000100:00100000:2.0:1789778430.670533:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1789778430.670544:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14454:x1876718296089856:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789778430.670652:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14454:x1876718296089856:12345-192.168.201.45@tcp:59:lhsmtool_posix.0 Request processed in 110us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778430.670660:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:1.0:1789778430.805513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778430.805609:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296089984 00000100:00100000:3.0:1789778430.805619:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296089984 00000100:00100000:3.0:1789778430.805696:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:3.0:1789778430.805707:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14460:x1876718296089984:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:3.0:1789778430.805737:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778430.805760:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7ff8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.805833:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.805849:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.805864:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.805879:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.805886:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.805892:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.806611:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.806628:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.806636:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.806642:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150ea00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778430.806647:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.806654:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807501:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:3.0:1789778430.807509:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778430.807515:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807523:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c11574421e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807540:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807546:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807552:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807557:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:3.0:1789778430.807570:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807576:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807586:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b3e82bb5a00) 00010000:00010000:3.0:1789778430.807588:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778430.807591:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807595:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807648:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ff8 expref: 10 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.807659:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:3.0:1789778430.807661:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789778430.807665:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7ff8 expref: 10 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.808180:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150e000, rc 0) 00000100:00100000:3.0:1789778430.808265:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14460:x1876718296089984:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 2558us (2762us total) trans 0 rc 301/301 00000100:00100000:3.0:1789778430.808286:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 18 00000100:00100000:0.0:1789778430.820592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778430.821008:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296090112 00000100:00100000:1.0:1789778430.821018:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296090112 00000100:00100000:1.0:1789778430.821116:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1789778430.821126:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14460:x1876718296090112:12345-192.168.201.45@tcp:700:lfs.0 00000100:00100000:1.0:1789778430.821505:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14460:x1876718296090112:12345-192.168.201.45@tcp:700:lfs.0 Request processed in 378us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778430.821513:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1789778430.827957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778430.828255:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296090368 00000100:00100000:3.0:1789778430.828265:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296090368 00000100:00100000:3.0:1789778430.828565:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 19 00000100:00100000:3.0:1789778430.828577:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14460:x1876718296090368:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:3.0:1789778430.828648:0:16026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778430.828676:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c1157442123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7f73 expref: 9 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.828710:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:3.0:1789778430.828716:0:16026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778430.828961:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.828976:0:16026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 5 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.828984:0:16026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.829018:0:16026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 5 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.829042:0:16026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 5 pid: 14408 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778430.829057:0:16026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16026:1876718314953344:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778430.829201:0:16026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789778430.837010:0:16026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16026:1876718314953344:192.168.201.45@tcp:104: 00010000:00010000:3.0:1789778430.837057:0:16026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778430.838757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778430.838931:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296090496 00000100:00100000:2.0:1789778430.838950:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296090496 00010000:00010000:2.0:1789778430.839012:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 6 pid: 14408 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778430.839059:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1789778430.839098:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2375:x1876718296090496:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778430.839113:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778430.839120:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 6 pid: 14408 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.839132:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 6 pid: 14408 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.839154:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c115744215b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fd5 expref: 6 pid: 14408 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.839183:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:2.0:1789778430.839189:0:14393:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.839197:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.839204:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.839230:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789778430.839380:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789778430.839555:0:16026:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.839571:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.839596:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.839606:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778430.839613:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778430.840503:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2375:x1876718296090496:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 1398us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778430.840528:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000004:00200000:2.0:1789778430.843327:0:16026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789778430.843345:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.843355:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.843363:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.843370:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150e000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778430.843375:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.843382:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.843411:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3e84f95a00) 00010000:00010000:2.0:1789778430.843414:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778430.843419:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.843425:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150e000/0x5a1e1c11574421f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778430.843452:0:16026:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000645bf8c8 reply state 00000000d1d648f4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778430.843461:0:16026:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789778430.843558:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+10:14460:x1876718296090368:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 14979us (15608us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789778430.843574:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 19 00010000:00010000:2.0:1789778430.870254:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.870286:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.870294:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.870301:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778430.870306:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.870314:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.870333:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b3e82bb5a00) 00010000:00010000:2.0:1789778430.870336:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778430.870340:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778430.870346:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f800/0x5a1e1c11574421fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778430.995750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778430.995947:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296090624 00000100:00100000:0.0:1789778430.995957:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296090624 00000100:00100000:0.0:1789778430.996021:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:0.0:1789778430.996032:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+9:14468:x1876718296090624:12345-192.168.201.45@tcp:101:lctl.0 00010000:00010000:0.0:1789778430.996058:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778430.996109:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e7fff expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.996191:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744220a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.996217:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.996229:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778430.996269:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789778430.996274:0:14408:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778430.996312:0:14408:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.996505:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fff expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.996528:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757200/0x5a1e1c115744220a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e7fff expref: 10 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778430.996537:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778430.996540:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778430.996543:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757200, rc 0) 00000100:00100000:0.0:1789778430.996604:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+10:14468:x1876718296090624:12345-192.168.201.45@tcp:101:lctl.0 Request processed in 573us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778430.996612:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 20 00000100:00100000:0.0:1789778431.039184:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.039376:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296090752 00000100:00100000:2.0:1789778431.039398:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296090752 00000100:00100000:2.0:1789778431.039475:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:2.0:1789778431.039486:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:14469:x1876718296090752:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778431.039506:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.039539:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157442211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8006 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.039608:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656800/0x5a1e1c1157442218 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.039622:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656800/0x5a1e1c1157442218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.039633:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656800/0x5a1e1c1157442218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778431.039666:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778431.039671:0:14407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778431.039700:0:14407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656800/0x5a1e1c1157442218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.039732:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157442211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8006 expref: 7 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.039749:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656800/0x5a1e1c1157442218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8006 expref: 6 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.039756:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778431.039759:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789778431.039762:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656800, rc 0) 00000100:00100000:2.0:1789778431.039832:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebfbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:14469:x1876718296090752:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 348us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778431.039839:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 21 00000100:00100000:1.0:1789778431.043234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.043420:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296090880 00000100:00100000:0.0:1789778431.043436:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296090880 00000100:00100000:0.0:1789778431.043689:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:0.0:1789778431.043702:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:14469:x1876718296090880:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778431.043886:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778431.043904:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744221f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e800d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.043956:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.043966:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.045360:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.045402:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.045414:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.045428:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.045616:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442234 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.045625:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.045632:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778431.045667:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789778431.045682:0:14408:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778431.045710:0:14408:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046212:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046220:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046228:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046234:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778431.046238:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046245:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046257:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778431.046260:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778431.046263:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046329:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c1157442226 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046343:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046350:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046370:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.046375:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778431.046378:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.047484:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.047499:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b3ea4c7aa00) 00010000:00010000:0.0:1789778431.047502:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778431.047505:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.047511:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744222d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.047564:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744221f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e800d expref: 8 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.047581:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442234 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e800d expref: 7 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.047588:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:0.0:1789778431.047590:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778431.047592:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756e00, rc 0) 00000100:00100000:0.0:1789778431.047771:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+7:14469:x1876718296090880:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 4070us (4548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778431.047795:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 22 00000100:00100000:1.0:1789778431.053455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.053612:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296091136 00000100:00100000:2.0:1789778431.053636:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296091136 00000100:00100000:2.0:1789778431.053844:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1789778431.053856:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+7:14469:x1876718296091136:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778431.053878:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.053900:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c115744223b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8014 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778431.053994:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789778431.054416:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c115744223b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8014 expref: 9 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.054433:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778431.054437:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778431.054442:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c115744223b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8014 expref: 9 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.054457:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657800, rc 0) 00000100:00100000:2.0:1789778431.054644:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+8:14469:x1876718296091136:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 789us (1201us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789778431.054653:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 23 00000100:00100000:2.0:1789778431.063376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778431.063606:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296091392 00000100:00100000:3.0:1789778431.063619:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296091392 00000100:00100000:3.0:1789778431.063696:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:3.0:1789778431.063707:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+8:14469:x1876718296091392:12345-192.168.201.45@tcp:36:lfs.0 00010000:00010000:3.0:1789778431.063880:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789778431.063907:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442234 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e800d expref: 8 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778431.063926:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3ea4c7af00) 00010000:00010000:3.0:1789778431.063936:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789778431.063962:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778431.063976:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778431.063987:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789778431.064965:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a4b6fb8 reply state 00000000f0df2840 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778431.064979:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789778431.064988:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789778431.065223:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+9:14469:x1876718296091392:12345-192.168.201.45@tcp:36:lfs.0 Request processed in 1513us (1854us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789778431.065232:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 24 00000100:00100000:1.0:1789778431.069970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.070053:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296091648 00000100:00100000:2.0:1789778431.070096:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296091648 00000100:00100000:2.0:1789778431.070162:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1789778431.070173:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+9:14469:x1876718296091648:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778431.070412:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+10:14469:x1876718296091648:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 240us (452us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789778431.070435:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00010000:00010000:0.0:1789778431.072056:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.072088:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.072096:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.072103:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150ea00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778431.072107:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.072115:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.072136:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3e82bb5c00) 00010000:00010000:0.0:1789778431.072139:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789778431.072144:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.072150:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150ea00/0x5a1e1c1157442249 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778431.074628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.074740:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296091904 00000100:00100000:2.0:1789778431.074751:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296091904 00000100:00100000:2.0:1789778431.074814:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:2.0:1789778431.074824:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+9:14469:x1876718296091904:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778431.074849:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.074869:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157442250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e801b expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.074943:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.074957:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.074968:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.074981:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.074988:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.074994:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778431.075160:0:16026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789778431.075249:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075286:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075292:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075298:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778431.075301:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075308:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075321:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778431.075324:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778431.075328:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075334:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075347:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075353:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075359:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075363:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778431.075372:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075379:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075396:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778431.075399:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778431.075401:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075406:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744225e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075443:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157442250 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e801b expref: 11 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075452:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778431.075453:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789778431.075457:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157442250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e801b expref: 11 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.075464:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657800, rc 0) 00000100:00100000:2.0:1789778431.075516:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+10:14469:x1876718296091904:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 694us (899us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789778431.075523:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 25 00000100:00100000:1.0:1789778431.080625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.080671:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296092032 00000100:00100000:0.0:1789778431.080684:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296092032 00000100:00100000:0.0:1789778431.081146:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:0.0:1789778431.081310:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+10:14469:x1876718296092032:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778431.081337:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778431.081374:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744226c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8022 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.081475:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.081489:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.081500:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778431.081524:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789778431.081528:0:14408:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778431.081544:0:14408:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.081571:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744226c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.081588:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.081596:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:0.0:1789778431.081598:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789778431.081601:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756000, rc 0) 00000100:00100000:0.0:1789778431.081667:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+11:14469:x1876718296092032:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 508us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778431.081674:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 26 00000100:00100000:1.0:1789778431.093601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.095265:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296092160 00000100:00100000:2.0:1789778431.100922:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296092160 00000100:00100000:2.0:1789778431.101001:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:2.0:1789778431.101010:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+11:14469:x1876718296092160:12345-192.168.201.45@tcp:37:lfs.0 00000100:00100000:2.0:1789778431.105637:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+11:14469:x1876718296092160:12345-192.168.201.45@tcp:37:lfs.0 Request processed in 4616us (12037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778431.105651:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:1.0:1789778431.110147:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778431.110469:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296092416 00000100:00100000:3.0:1789778431.110478:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296092416 00000100:00100000:2.0:1789778431.110643:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1789778431.110655:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf3ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+11:14469:x1876718296092416:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778431.111002:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf3ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+12:14469:x1876718296092416:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 348us (865us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789778431.111011:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00010000:00010000:0.0:1789778431.153598:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789778431.187463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.187562:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296092544 00000100:00100000:2.0:1789778431.187574:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296092544 00000100:00100000:2.0:1789778431.187643:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:2.0:1789778431.187654:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+10:14475:x1876718296092544:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778431.187686:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.187709:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c115744227a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8029 expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187776:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187791:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187802:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187817:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187842:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187849:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187943:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c115744228f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187953:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c115744228f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.187960:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c115744228f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778431.187987:0:16026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789778431.187991:0:16026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778431.188030:0:16026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c115744228f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188042:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188049:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188055:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188061:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778431.188086:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188101:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188113:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:2.0:1789778431.188116:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778431.188120:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188126:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c1157442281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188153:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188318:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188324:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188329:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778431.188332:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188339:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188347:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778431.188350:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778431.188352:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188368:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c1157442288 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188428:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c115744227a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8029 expref: 12 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188441:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657400/0x5a1e1c115744228f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8029 expref: 11 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.188448:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:2.0:1789778431.188451:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789778431.188453:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657400, rc 0) 00000100:00100000:2.0:1789778431.188518:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+11:14475:x1876718296092544:12345-192.168.201.45@tcp:101:bash.0 Request processed in 866us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778431.188526:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 27 00000100:00100000:1.0:1789778431.209922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.210044:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296092800 00000100:00100000:2.0:1789778431.210056:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296092800 00000100:00100000:2.0:1789778431.210147:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1789778431.210403:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+11:14475:x1876718296092800:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:2.0:1789778431.210425:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.210445:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157442296 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8030 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.210569:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.210585:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.210608:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.210641:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.210654:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 11 pid: 14408 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778431.210667:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14409:1876718314953472:192.168.201.45@tcp:104: 00000100:00100000:2.0:1789778431.211015:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e82f670c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789778431.218882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.218966:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296092928 00000100:00100000:0.0:1789778431.218976:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296092928 00010000:00010000:0.0:1789778431.219019:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 12 pid: 14408 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778431.219115:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1789778431.219125:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+12:2375:x1876718296092928:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778431.219154:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778431.219170:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 12 pid: 14408 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.219184:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 12 pid: 14408 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.219205:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:0.0:1789778431.219211:0:14394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.219221:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.219227:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.219247:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778431.219317:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+12:2375:x1876718296092928:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 193us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778431.219324:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00010000:00010000:2.0:1789778431.220598:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c1157442273 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8022 expref: 11 pid: 14408 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778431.220621:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14409:1876718314953472:192.168.201.45@tcp:104: 00010000:00010000:2.0:1789778431.220654:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.220664:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.220670:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.220706:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.220716:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.220740:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221815:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221829:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221838:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778431.221850:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789778431.221879:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221886:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221893:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221899:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778431.221903:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221910:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221921:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:2.0:1789778431.221925:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778431.221937:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.221943:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657e00/0x5a1e1c115744229d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789778431.221955:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c65ebee9 reply state 000000001ec801d2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778431.221964:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789778431.222000:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157442296 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 14 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.222014:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 13 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.226395:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:2.0:1789778431.226404:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789778431.226408:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657000, rc 0) 00000100:00100000:2.0:1789778431.226565:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+14:14475:x1876718296092800:12345-192.168.201.45@tcp:101:bash.0 Request processed in 16403us (16649us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789778431.226574:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00010000:00010000:2.0:1789778431.249155:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.249174:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.249181:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.249204:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778431.249210:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.249218:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.249235:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778431.249238:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789778431.249243:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.249250:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778431.254509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.254625:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296093056 00000100:00100000:0.0:1789778431.254651:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296093056 00000100:00100000:0.0:1789778431.254725:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:0.0:1789778431.254736:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+13:14475:x1876718296093056:12345-192.168.201.45@tcp:101:bash.0 00010000:00010000:0.0:1789778431.254763:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778431.254784:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8037 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.254852:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.254866:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.254879:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778431.254917:0:14407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789778431.254921:0:14407:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789778431.254943:0:14407:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.254954:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.254976:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 15 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.254995:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 14 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.255002:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:0.0:1789778431.255011:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778431.255015:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756800, rc 0) 00000100:00100000:0.0:1789778431.255361:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+14:14475:x1876718296093056:12345-192.168.201.45@tcp:101:bash.0 Request processed in 624us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778431.255368:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 29 00000100:00100000:1.0:1789778431.258595:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.258694:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296093312 00000100:00100000:2.0:1789778431.258704:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296093312 00000100:00100000:2.0:1789778431.258759:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1789778431.258769:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+14:14475:x1876718296093312:12345-192.168.201.45@tcp:35:bash.0 00000100:00100000:2.0:1789778431.259144:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+15:14475:x1876718296093312:12345-192.168.201.45@tcp:35:bash.0 Request processed in 376us (560us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789778431.259152:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:3.0:1789778431.356270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.356418:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296093568 00000100:00100000:0.0:1789778431.356427:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296093568 00000100:00100000:0.0:1789778431.356484:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:0.0:1789778431.356495:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+15:14485:x1876718296093568:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:0.0:1789778431.356518:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778431.356535:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e803e expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778431.356614:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789778431.356739:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e803e expref: 17 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.356752:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3ea4c7ab00) 00010000:00010000:0.0:1789778431.356755:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789778431.356760:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e803e expref: 17 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.356773:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757c00, rc 0) 00000100:00100000:0.0:1789778431.356831:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+16:14485:x1876718296093568:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 339us (580us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789778431.356839:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 30 00000100:00100000:1.0:1789778431.363537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.363628:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296093824 00000100:00100000:2.0:1789778431.363638:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296093824 00000100:00100000:2.0:1789778431.363701:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:2.0:1789778431.363719:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+16:14485:x1876718296093824:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778431.363946:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+17:14485:x1876718296093824:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 235us (417us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789778431.363967:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1789778431.432223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.432355:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296094080 00000100:00100000:2.0:1789778431.432427:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296094080 00000100:00100000:2.0:1789778431.432493:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:2.0:1789778431.432503:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+17:14488:x1876718296094080:12345-192.168.201.45@tcp:101:lfs.0 00010000:00010000:2.0:1789778431.432528:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.432547:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8045 expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.432633:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c11574422dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.432646:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c11574422dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.432656:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c11574422dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778431.432666:0:16026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789778431.432787:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8045 expref: 20 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.432805:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c11574422dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8045 expref: 19 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.432813:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:2.0:1789778431.432816:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778431.432819:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657800, rc 0) 00000100:00100000:2.0:1789778431.432890:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+19:14488:x1876718296094080:12345-192.168.201.45@tcp:101:lfs.0 Request processed in 388us (676us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789778431.432897:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 31 00000100:00100000:3.0:1789778431.441359:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.441493:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296094208 00000100:00100000:0.0:1789778431.441516:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296094208 00000100:00100000:0.0:1789778431.441579:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:0.0:1789778431.441589:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+19:14488:x1876718296094208:12345-192.168.201.45@tcp:54:lfs.0 00010000:00010000:0.0:1789778431.441655:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441684:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441698:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441723:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441730:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441738:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441744:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778431.441749:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441757:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441768:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:0.0:1789778431.441771:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789778431.441776:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.441792:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c11574422ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778431.441867:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+19:14488:x1876718296094208:12345-192.168.201.45@tcp:54:lfs.0 Request processed in 279us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778431.441875:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 32 00000100:00100000:1.0:1789778431.444257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.444338:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296094464 00000100:00100000:2.0:1789778431.444347:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296094464 00000100:00100000:2.0:1789778431.444408:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1789778431.444418:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+19:14488:x1876718296094464:12345-192.168.201.45@tcp:35:lfs.0 00000100:00100000:2.0:1789778431.444647:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+20:14488:x1876718296094464:12345-192.168.201.45@tcp:35:lfs.0 Request processed in 228us (398us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789778431.444654:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:1.0:1789778431.452692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.452834:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296094592 00000100:00100000:2.0:1789778431.452844:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296094592 00000100:00100000:2.0:1789778431.452909:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:2.0:1789778431.452919:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+20:2375:x1876718296094592:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778431.452936:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778431.452962:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c11574422dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8045 expref: 20 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.452978:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:2.0:1789778431.452983:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778431.453269:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+19:2375:x1876718296094592:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 350us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778431.453278:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000040:00080000:0.0:1789778431.474851:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789778431.822052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.824158:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296094848 00000100:00100000:2.0:1789778431.824172:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296094848 00000100:00100000:2.0:1789778431.824244:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:2.0:1789778431.824254:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+19:14519:x1876718296094848:12345-192.168.201.45@tcp:101:cat.0 00010000:00010000:2.0:1789778431.824303:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.824326:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c11574422f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e804c expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.824443:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.824459:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.824470:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778431.824483:0:16026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789778431.824650:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c11574422f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e804c expref: 22 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.824671:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e804c expref: 21 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.824679:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:2.0:1789778431.824682:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789778431.824685:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656200, rc 0) 00000100:00100000:2.0:1789778431.824872:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+21:14519:x1876718296094848:12345-192.168.201.45@tcp:101:cat.0 Request processed in 617us (2845us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789778431.824880:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 33 00000100:00100000:1.0:1789778431.833649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778431.833769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.834101:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296095232 00000100:00100000:2.0:1789778431.834111:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296095232 00000100:00100000:2.0:1789778431.834182:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:2.0:1789778431.834205:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+21:14519:x1876718296095232:12345-192.168.201.45@tcp:35:cat.0 00000100:00100000:2.0:1789778431.834535:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+22:14519:x1876718296095232:12345-192.168.201.45@tcp:35:cat.0 Request processed in 332us (765us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789778431.834543:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 8 00000100:00100000:0.0:1789778431.847863:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296094976 00000100:00100000:0.0:1789778431.847885:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296094976 00000100:00100000:0.0:1789778431.847969:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:0.0:1789778431.847979:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+22:2372:x1876718296094976:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789778431.847994:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778431.848018:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c11574422f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e804c expref: 22 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.848038:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:0.0:1789778431.848043:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789778431.848157:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+21:2372:x1876718296094976:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 179us (14520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778431.848164:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:1.0:1789778431.932709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.932822:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296095488 00000100:00100000:0.0:1789778431.932834:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296095488 00000100:00100000:0.0:1789778431.932902:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:0.0:1789778431.932914:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+21:14525:x1876718296095488:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:0.0:1789778431.932941:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778431.932964:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442306 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8053 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.933157:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.933174:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.933183:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 22 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.933191:0:14408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.933228:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 22 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.933243:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 22 pid: 14407 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778431.933256:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14408:1876718314953600:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778431.933363:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.933382:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 22 pid: 14409 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778431.933390:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14408:1876718314953728:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778431.933426:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e81377780 going to sleep for 11 seconds 00000100:00100000:0.0:1789778431.937434:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14408:1876718314953600:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778431.937453:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14408:1876718314953728:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778431.937482:0:14408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778431.938347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778431.938399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.938501:0:16522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296095616 00000100:00100000:2.0:1789778431.938511:0:16522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296095616 00010000:00010000:2.0:1789778431.938553:0:16522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 23 pid: 14407 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778431.938593:0:16522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296095744 00000100:00100000:2.0:1789778431.938597:0:16522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296095744 00010000:00010000:2.0:1789778431.938609:0:16522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 24 pid: 14409 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778431.938639:0:16522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1789778431.938649:0:16522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e95792450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+24:2374:x1876718296095616:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778431.938664:0:16522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778431.938670:0:16522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 24 pid: 14407 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938682:0:16522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 24 pid: 14407 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938705:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756800/0x5a1e1c11574422c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8037 expref: 24 pid: 14407 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938721:0:16522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:2.0:1789778431.938732:0:16522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938741:0:16522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938748:0:16522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778431.938804:0:16522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e95792450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+23:2374:x1876718296095616:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 156us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778431.938812:0:16522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1789778431.938864:0:16522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:2.0:1789778431.938873:0:16522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+22:2374:x1876718296095744:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778431.938881:0:16522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778431.938886:0:16522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 22 pid: 14409 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938896:0:16522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 22 pid: 14409 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938909:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574422ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8030 expref: 22 pid: 14409 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938919:0:16522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:2.0:1789778431.938922:0:16522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938930:0:16522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938947:0:16522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.938969:0:16522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778431.938989:0:16522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+21:2374:x1876718296095744:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 117us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778431.938996:0:16522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00010000:00010000:0.0:1789778431.939675:0:14408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.939689:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789778431.939712:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789778431.939903:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442306 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8053 expref: 22 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.939922:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756000/0x5a1e1c115744230d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8053 expref: 21 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.939930:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:0.0:1789778431.939933:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789778431.939935:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756000, rc 0) 00000100:00100000:0.0:1789778431.939988:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+21:14525:x1876718296095488:12345-192.168.201.45@tcp:101:dd.0 Request processed in 7076us (7292us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789778431.939997:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 34 00000100:00100000:1.0:1789778431.949443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.949541:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296096000 00000100:00100000:0.0:1789778431.949551:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296096000 00000100:00100000:0.0:1789778431.949608:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 35 00000100:00100000:0.0:1789778431.949630:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+21:14525:x1876718296096000:12345-192.168.201.45@tcp:36:dd.0 00010000:00010000:0.0:1789778431.949903:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.949922:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.949934:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789778431.949990:0:14407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789778431.950026:0:14407:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091b9439c reply state 000000005e521fcb transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778431.950035:0:14407:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789778431.950180:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14525:x1876718296096000:12345-192.168.201.45@tcp:36:dd.0 Request processed in 550us (748us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789778431.950187:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 35 00000020:00080000:0.0:1789778431.950193:0:14407:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789778431.952681:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.952701:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.952708:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.952715:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778431.952719:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.952744:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.952761:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:0.0:1789778431.952764:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789778431.952770:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.952776:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c115744231b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778431.953599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778431.953680:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296096128 00000100:00100000:2.0:1789778431.953692:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296096128 00000100:00100000:2.0:1789778431.953747:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:2.0:1789778431.953757:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+23:14525:x1876718296096128:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:2.0:1789778431.953781:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778431.953800:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157442322 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e805a expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.953860:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157442322 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e805a expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.953884:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157442322 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e805a expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778431.953904:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:2.0:1789778431.953907:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789778431.953910:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657000, rc 0) 00000100:00100000:2.0:1789778431.953967:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14525:x1876718296096128:12345-192.168.201.45@tcp:101:dd.0 Request processed in 212us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778431.953974:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 36 00000100:00100000:2.0:1789778431.982533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778431.982631:0:16522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296096384 00000100:00100000:1.0:1789778431.982641:0:16522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296096384 00000100:00100000:1.0:1789778431.982707:0:16522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:1.0:1789778431.982719:0:16522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14525:x1876718296096384:12345-192.168.201.45@tcp:103:dd.0 00010000:00010000:1.0:1789778431.982734:0:16522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778431.982759:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c1157442322 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e805a expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778431.982780:0:16522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:1.0:1789778431.982785:0:16522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778431.982849:0:16522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+23:14525:x1876718296096384:12345-192.168.201.45@tcp:103:dd.0 Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778431.982857:0:16522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:3.0:1789778431.985687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778431.985758:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296096512 00000100:00100000:0.0:1789778431.985768:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296096512 00000100:00100000:0.0:1789778431.985826:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:0.0:1789778431.985837:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+23:14525:x1876718296096512:12345-192.168.201.45@tcp:58:dd.0 00010000:00010000:0.0:1789778431.985947:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.985964:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778431.985976:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789778431.991201:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789778431.991383:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789778431.991466:0:14407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789778431.991613:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+23:14525:x1876718296096512:12345-192.168.201.45@tcp:58:dd.0 Request processed in 5773us (5939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778431.991625:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 37 00000100:00100000:2.0:1789778431.997852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778431.997921:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296096640 00000100:00100000:1.0:1789778431.997931:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296096640 00000100:00100000:1.0:1789778431.997995:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 38 00000100:00100000:1.0:1789778431.998007:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+23:14525:x1876718296096640:12345-192.168.201.45@tcp:101:dd.0 00010000:00010000:1.0:1789778431.998049:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778431.998099:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8061 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778431.998156:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778431.998168:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8061 expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778431.998208:0:14409:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778431.998222:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8061 expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778431.998237:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:1.0:1789778431.998240:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789778431.998243:0:14409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8061 expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778431.998251:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f76600, rc 0) 00000100:00100000:1.0:1789778431.998319:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14525:x1876718296096640:12345-192.168.201.45@tcp:101:dd.0 Request processed in 315us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778431.998327:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 38 00010000:00010000:1.0:1789778432.178459:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789778432.497462:0:14439:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789778432.497471:0:14439:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778432.497508:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789778432.497514:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789778432.497634:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14439:1876718314953856:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789778432.497771:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789778432.501437:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17aad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14439:1876718314953856:192.168.201.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789778432.502311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778432.507149:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296096768 00000100:00100000:1.0:1789778432.507167:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296096768 00000100:00100000:1.0:1789778432.507254:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1789778432.507267:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14526:x1876718296096768:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789778432.507584:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14526:x1876718296096768:12345-192.168.201.45@tcp:900:lhsmtool_posix.0 Request processed in 320us (5275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778432.507593:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00080000:0.0:1789778432.507788:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789778432.522748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778432.522878:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296096896 00000100:00100000:1.0:1789778432.522901:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296096896 00000100:00100000:1.0:1789778432.522961:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:1.0:1789778432.522970:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14526:x1876718296096896:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789778432.523000:0:16026:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789778432.523167:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14526:x1876718296096896:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 197us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778432.523175:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 39 00000100:00100000:2.0:1789778432.528703:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778432.528774:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296097024 00000100:00100000:1.0:1789778432.528784:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296097024 00000100:00100000:1.0:1789778432.528845:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:1.0:1789778432.528856:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14526:x1876718296097024:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789778432.528922:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.528935:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.528944:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529009:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529014:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529018:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529034:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529049:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529054:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778432.529112:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789778432.529115:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789778432.529124:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529132:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529136:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529141:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529144:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f77200 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.529147:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529152:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529159:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:1.0:1789778432.529161:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778432.529164:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529175:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77200/0x5a1e1c1157442337 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529185:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529188:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529192:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529195:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f77800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.529196:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529200:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529204:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b3e84f95c00) 00010000:00010000:1.0:1789778432.529205:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778432.529207:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529210:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77800/0x5a1e1c115744233e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529222:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529225:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529233:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529236:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f76000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.529237:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529240:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529244:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:1.0:1789778432.529246:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778432.529247:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.529250:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c1157442345 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778432.529303:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14526:x1876718296097024:12345-192.168.201.45@tcp:34:lhsmtool_posix.0 Request processed in 450us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778432.529308:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 40 00000100:00100000:3.0:1789778432.532913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778432.532995:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296097280 00000100:00100000:1.0:1789778432.533016:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296097280 00000100:00100000:1.0:1789778432.533103:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:1.0:1789778432.533115:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+24:14526:x1876718296097280:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789778432.533146:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789778432.533167:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c115744234c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8068 expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533283:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533298:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533311:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789778432.533322:0:16026:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789778432.533811:0:16026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533820:0:16026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533826:0:16026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533832:0:16026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f77400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.533836:0:16026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533843:0:16026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533856:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:1.0:1789778432.533859:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789778432.533863:0:16026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533882:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442353 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533928:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c115744234c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8068 expref: 26 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533939:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b3ea4c7a300) 00010000:00010000:1.0:1789778432.533941:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789778432.533945:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77e00/0x5a1e1c115744234c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8068 expref: 26 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.533954:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3d81f77e00, rc 0) 00000100:00100000:1.0:1789778432.534023:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+25:14526:x1876718296097280:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 911us (1119us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789778432.534031:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 41 00000100:00100000:2.0:1789778432.537881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778432.537965:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296097408 00000100:00100000:1.0:1789778432.537975:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296097408 00000100:00100000:1.0:1789778432.538040:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:1.0:1789778432.538053:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+25:14526:x1876718296097408:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789778432.538152:0:14409:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789778432.538248:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+25:14526:x1876718296097408:12345-192.168.201.45@tcp:53:lhsmtool_posix.0 Request processed in 197us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778432.538255:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 42 00000100:00100000:2.0:1789778432.548411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.548596:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296097664 00000100:00100000:0.0:1789778432.548607:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296097664 00000100:00100000:0.0:1789778432.548688:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:0.0:1789778432.548699:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+25:14526:x1876718296097664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778432.548724:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778432.548747:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442361 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e806f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789778432.550191:0:14407:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1789778432.550200:0:14407:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789778432.550253:0:14407:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789778432.552293:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c1157442368 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.552315:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c1157442368 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.552328:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c1157442368 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.552421:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442361 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e806f expref: 28 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.552464:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c1157442368 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e806f expref: 27 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.552474:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3ea4c7a800) 00010000:00010000:0.0:1789778432.552477:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789778432.552481:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756a00, rc 0) 00000100:00100000:0.0:1789778432.552554:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+27:14526:x1876718296097664:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 3857us (4153us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789778432.552561:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 43 00000100:00100000:3.0:1789778432.567702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778432.567843:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296097920 00000100:00100000:1.0:1789778432.567853:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296097920 00000100:00100000:1.0:1789778432.567916:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1789778432.567940:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+27:14526:x1876718296097920:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789778432.568009:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778432.568035:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c1157442368 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e806f expref: 27 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568053:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3ea4c7a800) 00010000:00010000:1.0:1789778432.568117:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789778432.568141:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568155:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568166:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568182:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568188:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568194:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568261:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568268:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568285:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568290:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f77400 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.568295:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568302:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568311:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b3ea4c7aa00) 00010000:00010000:1.0:1789778432.568314:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778432.568318:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568324:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f77400/0x5a1e1c1157442376 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568333:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568339:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568345:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568350:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f76000 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.568353:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568559:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568569:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x855d4986 (ffff9b3e84f95c00) 00010000:00010000:1.0:1789778432.568571:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778432.568574:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.568579:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76000/0x5a1e1c115744237d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x855d4986 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778432.568680:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+26:14526:x1876718296097920:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 741us (987us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789778432.568688:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 44 00000100:00100000:1.0:1789778432.571149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778432.571271:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296098048 00000100:00100000:2.0:1789778432.571282:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296098048 00000100:00100000:2.0:1789778432.571342:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1789778432.571351:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+26:14526:x1876718296098048:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778432.571487:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778432.571511:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157442384 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8076 expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.571551:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744238b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.571563:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744238b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.571574:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744238b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.571686:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657800/0x5a1e1c1157442384 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8076 expref: 28 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.571704:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81656200/0x5a1e1c115744238b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8076 expref: 27 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.571723:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778432.571726:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789778432.571730:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81656200, rc 0) 00000100:00100000:2.0:1789778432.571787:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+27:14526:x1876718296098048:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 437us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778432.571795:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 45 00000100:00100000:2.0:1789778432.582125:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.582214:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296098304 00000100:00100000:0.0:1789778432.582222:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296098304 00000100:00100000:0.0:1789778432.582277:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 46 00000100:00100000:0.0:1789778432.582287:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+27:14526:x1876718296098304:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789778432.582402:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.582419:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.582432:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789778432.582853:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789778432.582866:0:14408:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487540800254ns, next at 488540796234ns, rc = 0 00000004:00010000:0.0:1789778432.582951:0:14408:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9d103df reply state 00000000d10d7ec0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778432.582971:0:14408:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789778432.583111:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+29:14526:x1876718296098304:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 824us (995us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789778432.583119:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 46 00010000:00010000:2.0:1789778432.586045:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.586077:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.586086:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.586091:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:2.0:1789778432.586095:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.586103:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.586118:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778432.586120:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789778432.586125:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.586132:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c1157442392 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778432.598139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.598765:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296098432 00000100:00100000:0.0:1789778432.598777:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296098432 00000100:00100000:0.0:1789778432.598838:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:0.0:1789778432.598848:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+28:14526:x1876718296098432:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778432.598872:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778432.598894:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e807d expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.598953:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 29 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.598968:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 29 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.598988:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:0.0:1789778432.598991:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778432.598994:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95757a00, rc 0) 00000100:00100000:0.0:1789778432.599258:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+29:14526:x1876718296098432:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 410us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778432.599266:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 47 00000100:00100000:3.0:1789778432.611185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778432.611313:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296098560 00000100:00100000:2.0:1789778432.611324:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296098560 00000100:00100000:2.0:1789778432.611407:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:2.0:1789778432.611418:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2374:x1876718296098560:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789778432.611798:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789778432.611944:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2374:x1876718296098560:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 527us (766us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789778432.611951:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:1.0:1789778432.617440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778432.617536:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296098816 00000100:00100000:2.0:1789778432.617546:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296098816 00000100:00100000:2.0:1789778432.617596:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:2.0:1789778432.617603:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+29:14526:x1876718296098816:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789778432.617912:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+30:14526:x1876718296098816:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 307us (480us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789778432.617919:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 9 00000100:00100000:1.0:1789778432.621101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.621176:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296099072 00000100:00100000:0.0:1789778432.621199:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296099072 00000100:00100000:0.0:1789778432.621246:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:0.0:1789778432.621253:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+30:14526:x1876718296099072:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789778432.621376:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+30:14526:x1876718296099072:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778432.621383:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 48 00000100:00100000:3.0:1789778432.623841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778432.623948:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296099200 00000100:00100000:2.0:1789778432.623957:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296099200 00000100:00100000:2.0:1789778432.624006:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1789778432.624012:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+30:14526:x1876718296099200:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789778432.624028:0:16026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789778432.624046:0:16026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657600/0x5a1e1c11574423a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8084 expref: -99 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.624125:0:16026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574423a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.624148:0:16026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574423a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.624160:0:16026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574423a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789778432.624194:0:16026:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789778432.624211:0:16026:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574423a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16026 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.624233:0:16026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657600/0x5a1e1c11574423a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8084 expref: 32 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.624246:0:16026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574423a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8084 expref: 31 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.624252:0:16026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778432.624254:0:16026:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789778432.624257:0:16026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e81657000, rc 0) 00000100:00100000:2.0:1789778432.624296:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+31:14526:x1876718296099200:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 285us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778432.624300:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 49 00000100:00100000:2.0:1789778432.632543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.634113:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296099328 00000100:00100000:0.0:1789778432.634125:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296099328 00000100:00100000:0.0:1789778432.634180:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:0.0:1789778432.634188:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+6:2372:x1876718296099328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789778432.634202:0:15095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789778432.634217:0:15095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e808b expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789778432.634237:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aadda00, blocks: 0x1 00010000:00010000:0.0:1789778432.634252:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1789778432.634256:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778432.634263:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 7 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.634278:0:15095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 7 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.634287:0:15095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e95756600, rc 0) 00000100:00100000:0.0:1789778432.634347:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2372:x1876718296099328:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 159us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778432.634383:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 12 00000100:00100000:1.0:1789778432.637366:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.637501:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296099584 00000100:00100000:0.0:1789778432.637513:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296099584 00000100:00100000:0.0:1789778432.637565:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:0.0:1789778432.637572:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+31:14526:x1876718296099584:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789778432.637712:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+31:14526:x1876718296099584:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 138us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778432.637717:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 50 00000100:00100000:3.0:1789778432.660627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778432.660750:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296099712 00000100:00100000:2.0:1789778432.660761:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296099712 00000100:00100000:2.0:1789778432.660823:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 51 00000100:00100000:2.0:1789778432.660833:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+31:14526:x1876718296099712:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789778432.748745:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+31:14526:x1876718296099712:12345-192.168.201.45@tcp:44:lhsmtool_posix.0 Request processed in 87900us (88115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778432.748759:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 51 00000001:00080000:3.0:1789778432.749632:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1789778432.749641:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789778432.754987:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314953984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789778432.755096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789778432.755296:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314953984 00000100:00100000:2.0:1789778432.755317:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314953984 00000100:00100000:2.0:1789778432.755396:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789778432.755406:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876718314953984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789778432.755570:0:15094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789778432.755575:0:15094:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789778432.755577:0:15094:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789778432.755579:0:15094:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789778432 -> 1789778432 00002000:00010000:2.0:1789778432.755581:0:15094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1789778432.755826:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789778432.755989:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1789778432.756008:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789778432.757490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778432.757531:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789778432.757540:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789778432.760142:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296099840 00000100:00100000:0.0:1789778432.760157:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296099840 00000100:00100000:3.0:1789778432.760419:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:3.0:1789778432.760438:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2372:x1876718296099840:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789778432.760574:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2372:x1876718296099840:12345-192.168.201.45@tcp:16:lhsmtool_posix.0 Request processed in 139us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778432.760582:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:2.0:1789778432.761945:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876718314953984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6534us (6876us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789778432.761956:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1789778432.764824:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3ec17a9880/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789778432.764841:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876718314953984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789778432.778808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.779117:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296100096 00000100:00100000:0.0:1789778432.779127:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296100096 00000100:00100000:0.0:1789778432.779192:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1789778432.779203:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+14:14526:x1876718296100096:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789778432.779268:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789778432.779297:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e81657000/0x5a1e1c11574423a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8084 expref: 14 pid: 16026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.779317:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:0.0:1789778432.779322:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789778432.779361:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.779376:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.779405:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789778432.779608:0:14408:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f7bb2d3 reply state 000000005ab744dd transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778432.779618:0:14408:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789778432.779727:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+15:14526:x1876718296100096:12345-192.168.201.45@tcp:36:lhsmtool_posix.0 Request processed in 524us (927us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789778432.779735:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 52 00000100:00100000:0.0:1789778432.789466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778432.791831:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296100224 00000100:00100000:3.0:1789778432.791846:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296100224 00000100:00100000:3.0:1789778432.791918:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778432.791927:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+7:14526:x1876718296100224:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789778432.791945:0:15093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789778432.791962:0:15093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6c23ca88fd9e8092 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.791992:0:15093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 8 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.792002:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778432.792006:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789778432.792011:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.792050:0:15093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 8 pid: 15095 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.792098:0:15093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 8 pid: 15095 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778432.792134:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ec17a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15093:1876718314954112:192.168.201.45@tcp:104: 00000100:00100000:3.0:1789778432.792211:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3eb5de50c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789778432.793638:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.793668:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.793676:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.793682:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.793687:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.793695:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.793711:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:1.0:1789778432.793714:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778432.793718:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.793724:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757e00/0x5a1e1c11574423b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778432.800593:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ec17a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15093:1876718314954112:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778432.800633:0:15093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.800654:0:15093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3e8150f000, rc 0) 00000100:00100000:0.0:1789778432.800715:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+8:14526:x1876718296100224:12345-192.168.201.45@tcp:101:lhsmtool_posix.0 Request processed in 8788us (11261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778432.800723:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778432.801368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778432.801604:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296100352 00000100:00100000:2.0:1789778432.801613:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296100352 00010000:00010000:2.0:1789778432.801647:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 8 pid: 15095 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778432.801681:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:2.0:1789778432.801691:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+8:2375:x1876718296100352:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778432.801704:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778432.801726:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 8 pid: 15095 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.801739:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 8 pid: 15095 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.801763:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ae5a24/0x5a1e1c11574423ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e808b expref: 8 pid: 15095 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.801791:0:14393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778432.801795:0:14393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778432.801802:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 7 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.801812:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 7 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.801845:0:14393:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 7 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778432.801859:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14393:1876718314954240:192.168.201.45@tcp:105: 00000100:00100000:2.0:1789778432.801928:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e90d096c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789778432.810490:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb5855180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14393:1876718314954240:192.168.201.45@tcp:105: 00010000:00010000:2.0:1789778432.810520:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778432.810586:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2375:x1876718296100352:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 8895us (9219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778432.810596:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 13 00000100:00100000:0.0:1789778432.819120:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778432.822434:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296100480 00000100:00100000:3.0:1789778432.822450:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296100480 00000100:00100000:2.0:1789778432.822751:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1789778432.822763:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2374:x1876718296100480:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789778432.823256:0:16638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789778432.823261:0:16638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789778432 00002000:00010000:2.0:1789778432.823263:0:16638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789778431 00002000:00010000:2.0:1789778432.823279:0:16638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789778432 -> 1789778432 00002000:00010000:2.0:1789778432.823282:0:16638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789778432.823369:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+8:2374:x1876718296100480:12345-192.168.201.45@tcp:2:lhsmtool_posix.0 Request processed in 607us (4523us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789778432.823378:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:3.0:1789778432.834111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.834367:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296100608 00000100:00100000:0.0:1789778432.834377:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296100608 00000100:00100000:0.0:1789778432.834434:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:0.0:1789778432.834445:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+8:2372:x1876718296100608:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789778432.834487:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.834520:0:15095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.834528:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778432.834533:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789778432.834537:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.834585:0:15095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.834599:0:15095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 8 pid: 15093 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778432.834615:0:15095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15095:1876718314954368:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778432.834695:0:15095:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789778432.838800:0:15095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15095:1876718314954368:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778432.838831:0:15095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778432.844446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:1.0:1789778432.844604:0:16522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296100736 00000100:00100000:1.0:1789778432.844616:0:16522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296100736 00010000:00010000:1.0:1789778432.844660:0:16522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 9 pid: 15093 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778432.844702:0:16522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 14 00000100:00100000:1.0:1789778432.844713:0:16522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec17a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+9:2374:x1876718296100736:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789778432.844729:0:16522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789778432.844766:0:16522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 9 pid: 15093 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.844780:0:16522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 9 pid: 15093 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.844804:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f90876da/0x5a1e1c11574423bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8092 expref: 9 pid: 15093 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.844825:0:16522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789778432.844829:0:16522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789778432.844835:0:16522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.844845:0:16522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.844889:0:16522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789778432.844950:0:16522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+8:2374:x1876718296100736:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 238us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778432.844958:0:16522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 14 00010000:00010000:0.0:1789778432.845105:0:15095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845126:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845161:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845170:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845178:0:15095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845185:0:15095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778432.845189:0:15095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845198:0:15095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845212:0:15095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.845220:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad50d336/0x5a1e1c11574423c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778432.845285:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec17a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2372:x1876718296100608:12345-192.168.201.45@tcp:1:lhsmtool_posix.0 Request processed in 10841us (11221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778432.845304:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1789778432.855386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778432.855486:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296100992 00000100:00100000:0.0:1789778432.855496:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296100992 00000100:00100000:0.0:1789778432.856172:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 53 00000100:00100000:0.0:1789778432.856185:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+14:14526:x1876718296100992:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789778432.856273:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.856290:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.856303:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.856955:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.856970:0:14407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 15 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.856978:0:14407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.857016:0:14407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 15 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.857293:0:14407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 15 pid: 14407 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778432.857324:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14407:1876718314954496:192.168.201.45@tcp:104: 00000100:00100000:0.0:1789778432.857480:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e88d36d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789778432.867425:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14407:1876718314954496:192.168.201.45@tcp:104: 00010000:00010000:0.0:1789778432.867459:0:14407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778432.873604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778432.879385:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296101120 00000100:00100000:3.0:1789778432.879403:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296101120 00010000:00010000:2.0:1789778432.884458:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 16 pid: 14407 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778432.884573:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:2.0:1789778432.884585:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb5856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+16:2375:x1876718296101120:12345-192.168.201.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789778432.884601:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789778432.884609:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 16 pid: 14407 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.884623:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 16 pid: 14407 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.884645:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757a00/0x5a1e1c1157442399 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e807d expref: 16 pid: 14407 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.884674:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778432.884680:0:14394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.884691:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.884713:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.884751:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789778432.884818:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+15:2375:x1876718296101120:12345-192.168.201.45@tcp:103:ldlm_bl.0 Request processed in 235us (11285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778432.884826:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00010000:00010000:0.0:1789778432.887593:0:14407:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.887613:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789778432.887816:0:14407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789778432.889114:0:14407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789778432.889170:0:14407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789778432.889434:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14407:1876718314954624:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789778432.889559:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778432.889586:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e982c1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789778432.890164:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314954624 00000100:00100000:1.0:1789778432.890174:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314954624 00000100:00100000:1.0:1789778432.890229:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789778432.890251:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14407:x1876718314954624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789778432.890331:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14407:x1876718314954624:12345-0@lo:1000:mdt00_000.0 Request processed in 93us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778432.890367:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789778432.890565:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3ebfbef480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14407:1876718314954624:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789778432.893017:0:14407:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789778432.893212:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14407:1876718314954752:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789778432.894024:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778432.894597:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658840 going to sleep for 11 seconds 00000100:00100000:1.0:1789778432.899342:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314954752 00000100:00100000:1.0:1789778432.899368:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314954752 00000100:00100000:1.0:1789778432.899438:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789778432.899450:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14407:x1876718314954752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789778432.900104:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14407:x1876718314954752:12345-0@lo:1000:mdt00_000.0 Request processed in 654us (6078us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789778432.900113:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789778432.909444:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14407:1876718314954752:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789778432.909983:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.909995:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.910020:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.910026:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756a00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778432.911159:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911173:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911192:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:0.0:1789778432.911195:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778432.911200:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911208:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756a00/0x5a1e1c11574423d1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911816:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911825:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911832:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911837:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757c00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:0.0:1789778432.911840:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911976:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.911987:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:0.0:1789778432.911990:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789778432.911998:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8061 expref: 18 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.912009:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8061 expref: 18 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.912019:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8061 expref: 18 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.913362:0:14407:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76600/0x5a1e1c1157442330 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.45@tcp remote: 0x6c23ca88fd9e8061 expref: 18 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778432.913384:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14407:1876718314954880:192.168.201.45@tcp:105: 00000100:00100000:0.0:1789778432.913495:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b3e98658600 going to sleep for 11 seconds 00000100:00100000:1.0:1789778432.921699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778432.921840:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296101248 00000100:00100000:2.0:1789778432.921867:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296101248 00000100:00100000:2.0:1789778432.921934:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:2.0:1789778432.921944:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ebf3aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+19:14525:x1876718296101248:12345-192.168.201.45@tcp:49:dd.0 00000100:00100000:2.0:1789778432.922153:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ebf3aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+19:14525:x1876718296101248:12345-192.168.201.45@tcp:49:dd.0 Request processed in 199us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778432.922162:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 10 00000100:00100000:0.0:1789778432.925424:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14407:1876718314954880:192.168.201.45@tcp:105: 00010000:00010000:0.0:1789778432.925461:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778432.925472:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95757c00/0x5a1e1c1157442329 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.925954:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.925973:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.925985:0:14407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.925996:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926002:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926008:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926013:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f76800 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.926017:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926725:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926808:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:1.0:1789778432.926812:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789778432.926816:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926823:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3d81f76800/0x5a1e1c11574423d8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926837:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926843:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926922:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926930:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756e00 already unused, calling callback (ffffffffc1f664f0) 00010000:00010000:1.0:1789778432.926934:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926942:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926952:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b3e85f15f00) 00010000:00010000:1.0:1789778432.926955:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789778432.926958:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778432.926976:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e95756e00/0x5a1e1c11574423ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14407 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778432.928702:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb5855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:994018b1-ce46-430d-a31b-a5e08e23dff3+18:14526:x1876718296100992:12345-192.168.201.45@tcp:57:lhsmtool_posix.0 Request processed in 72512us (73317us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789778432.928715:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 53 00000020:00080000:1.0:1789778432.928722:0:14407:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789778432.934008:0:14439:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789778432.934021:0:14439:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789778432.934171:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789778432.934178:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789778432.935842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778432.936114:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296101504 00000100:00100000:3.0:1789778432.936125:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296101504 00000100:00100000:3.0:1789778432.936200:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 11 00000100:00100000:3.0:1789778432.936212:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+18:14526:x1876718296101504:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789778432.936910:0:14411:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789778432.937033:0:14411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1789778432.937123:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.937140:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.937152:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.937161:0:14411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.937167:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.937180:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789778432.937200:0:14411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789778432.937224:0:16030:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789778432.937234:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.937254:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e8150f600 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778432.937258:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.937267:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.937282:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b3e85f15700) 00010000:00010000:2.0:1789778432.937291:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789778432.937297:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778432.937302:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3e8150f600/0x5a1e1c11574423df lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778432.937319:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+20:14526:x1876718296101504:12345-192.168.201.45@tcp:35:lhsmtool_posix.0 Request processed in 1104us (1481us total) trans 8589934622 rc 0/0 00010000:00010000:2.0:1789778432.937319:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778432.937323:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789778432.937326:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778432.937333:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 11 00000020:00080000:3.0:1789778432.937339:0:14411:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789778433.147829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778433.147877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778433.148006:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296101760 00000100:00100000:0.0:1789778433.148017:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296101760 00000100:00100000:0.0:1789778433.148128:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296101632 00000100:00100000:0.0:1789778433.148132:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296101632 00000100:00100000:0.0:1789778433.148154:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:0.0:1789778433.148163:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+8:2374:x1876718296101760:12345-192.168.201.45@tcp:4:dd.0 00002000:00010000:0.0:1789778433.148209:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aadda00, atime: 0x6aadd9ff, ctime: 0x6aadda00, blocks: 0x1 00010000:00010000:0.0:1789778433.148219:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.148235:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1789778433.148240:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778433.148246:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.148273:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778433.157728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778433.157774:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778433.157802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778433.157813:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:0.0:1789778433.157824:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778433.157829:0:15100:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789778433.157839:0:15100:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789778433.157842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778433.157918:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789778433.157934:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102016 00000100:00100000:3.0:1789778433.157943:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102016 00000100:00100000:3.0:1789778433.158002:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789778433.158009:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296101888 00000100:00100000:3.0:1789778433.158012:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296101888 00000100:00100000:3.0:1789778433.158027:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789778433.158031:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102272 00000100:00100000:3.0:1789778433.158033:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102272 00000100:00100000:3.0:1789778433.158045:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789778433.158049:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102144 00000100:00100000:3.0:1789778433.158051:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102144 00000100:00100000:3.0:1789778433.158062:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789778433.158112:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102528 00000100:00100000:3.0:1789778433.158115:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102528 00000100:00100000:3.0:1789778433.158128:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789778433.158131:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102400 00000100:00100000:3.0:1789778433.158132:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102400 00000100:00100000:2.0:1789778433.160308:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1789778433.160326:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+15:2374:x1876718296101632:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:2.0:1789778433.160374:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.160392:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.160396:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.160402:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.160414:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.206926:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789778433.290038:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1789778433.290062:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1789778433.290086:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789778433.290208:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1789778433.290217:0:15099:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789778432 -> 1789778433 00002000:00010000:1.0:1789778433.290220:0:15099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789778432 -> 1789778433 00002000:00010000:1.0:1789778433.290222:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1789778433.290238:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290252:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290261:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290267:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95757c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778433.290271:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290280:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290323:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290331:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c328b85e/0x5a1e1c11574423e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778433.290428:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+13:2374:x1876718296101760:12345-192.168.201.45@tcp:4:dd.0 Request processed in 142261us (142604us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789778433.290454:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 0 00000100:00100000:1.0:1789778433.290487:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:1.0:1789778433.290510:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+12:2374:x1876718296102016:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:1.0:1789778433.290543:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290555:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778433.290559:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778433.290563:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.290575:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.290991:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291013:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291020:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291025:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778433.291028:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291035:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291045:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291051:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c11574423ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778433.291140:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+12:2374:x1876718296101632:12345-192.168.201.45@tcp:4:dd.0 Request processed in 130817us (143259us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789778433.291148:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 1 00000100:00100000:2.0:1789778433.291167:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:2.0:1789778433.291176:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+11:2374:x1876718296101888:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:2.0:1789778433.291196:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291212:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.291215:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.291220:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.291229:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789778433.293258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778433.293610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778433.293650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778433.293674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:3.0:1789778433.293942:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102784 00000100:00100000:3.0:1789778433.293961:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102784 00000100:00100000:3.0:1789778433.294014:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296103040 00000100:00100000:3.0:1789778433.294018:0:16638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296103040 00000100:00100000:3.0:1789778433.294045:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00100000:3.0:1789778433.294055:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2372:x1876718296102784:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778433.294191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.45@tcp (source: 12345-192.168.201.45@tcp) 00000100:00100000:2.0:1789778433.294210:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296103168 00000100:00100000:2.0:1789778433.294214:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296103168 00000100:00100000:2.0:1789778433.294237:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1789778433.294244:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296103040:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778433.294386:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296103040:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 141us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778433.294394:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 16 00000100:00100000:2.0:1789778433.294411:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1789778433.294418:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296103168:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778433.294446:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+5:2372:x1876718296103168:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 29us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778433.294451:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 17 00000100:00100000:2.0:1789778433.294483:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102656 00000100:00100000:2.0:1789778433.294486:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102656 00000100:00100000:2.0:1789778433.294589:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1789778433.294596:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+13:2372:x1876718296102656:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778433.294623:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f7eb169-d267-4201-9b8c-0564b642e934+13:2372:x1876718296102656:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 27us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778433.294629:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 123 00000100:00100000:2.0:1789778433.295265:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718296102912 00000100:00100000:2.0:1789778433.295272:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718296102912 00000100:00100000:2.0:1789778433.295420:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:2.0:1789778433.295429:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2372:x1876718296102912:12345-192.168.201.45@tcp:400:kworker.0 00000100:00100000:2.0:1789778433.295471:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ec16f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d1ff6a2-4a4e-4155-be32-b0cc5d1f3fc1+6:2372:x1876718296102912:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 43us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778433.295477:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 28 00000100:00100000:3.0:1789778433.296527:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+5:2372:x1876718296102784:12345-192.168.201.45@tcp:400:kworker.0 Request processed in 2468us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778433.296536:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 15 00000100:00080000:3.0:1789778433.296560:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789778433.296566:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789778433.296569:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789778433.372871:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789778433.375241:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:2.0:1789778433.375252:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789778433.375267:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375280:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375288:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375295:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f76a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778433.375316:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375325:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375358:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375366:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004109ac7c/0x5a1e1c11574423f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778433.375469:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+13:2374:x1876718296102016:12345-192.168.201.45@tcp:4:dd.0 Request processed in 84968us (217745us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789778433.375480:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 2 00000100:00100000:2.0:1789778433.375527:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:2.0:1789778433.375541:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+12:2374:x1876718296102272:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:2.0:1789778433.375574:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375587:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.375591:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.375596:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.375607:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789778433.428081:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1789778433.437188:0:16639:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1789778433.437195:0:16639:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1789778433.437212:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437227:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437237:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437244:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81656c00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778433.437249:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437267:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437287:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437294:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e8abf0d/0x5a1e1c11574423fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778433.437403:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+12:2374:x1876718296101888:12345-192.168.201.45@tcp:4:dd.0 Request processed in 146223us (279623us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789778433.437414:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 3 00000100:00100000:0.0:1789778433.437455:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:0.0:1789778433.437467:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+11:2374:x1876718296102144:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:0.0:1789778433.437511:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437524:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778433.437528:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789778433.437535:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.437548:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778433.486302:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1789778433.512235:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1789778433.512262:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.512289:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.512299:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.512305:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657e00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:1.0:1789778433.512310:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.512319:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.512349:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.512356:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000625bca3c/0x5a1e1c1157442402 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789778433.512448:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+11:2374:x1876718296102272:12345-192.168.201.45@tcp:4:dd.0 Request processed in 136907us (354639us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789778433.512458:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 4 00000100:00100000:1.0:1789778433.512491:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 6 00000100:00100000:1.0:1789778433.512503:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+10:2374:x1876718296102528:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:1.0:1789778433.514444:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.514485:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778433.514490:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789778433.514498:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789778433.515134:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778433.629430:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1789778433.629456:0:16639:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:2.0:1789778433.629473:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.629486:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.629494:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.629500:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e95756a00 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778433.629505:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.629513:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.629535:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.629543:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073b19917/0x5a1e1c1157442409 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778433.629657:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+10:2374:x1876718296102144:12345-192.168.201.45@tcp:4:dd.0 Request processed in 192188us (471836us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789778433.629682:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 5 00000100:00100000:2.0:1789778433.629713:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.45@tcp, seq: 7 00000100:00100000:2.0:1789778433.629725:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+9:2374:x1876718296102400:12345-192.168.201.45@tcp:4:dd.0 00010000:00010000:2.0:1789778433.629757:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.629771:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.629775:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789778433.629782:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.630034:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789778433.675876:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1789778433.676208:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789778433.676223:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.676236:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.676245:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.676252:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3d81f77200 already unused, calling callback (ffffffffc151c370) 00010000:00010000:0.0:1789778433.676257:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.676282:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.676302:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789778433.676388:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004798f3cf/0x5a1e1c1157442410 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789778433.676517:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:994018b1-ce46-430d-a31b-a5e08e23dff3+9:2374:x1876718296102528:12345-192.168.201.45@tcp:4:dd.0 Request processed in 164013us (518686us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789778433.676527:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 6 00002000:00010000:2.0:1789778433.725205:0:16639:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789778433.725225:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.725238:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.725247:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.725254:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3e81657800 already unused, calling callback (ffffffffc151c370) 00010000:00010000:2.0:1789778433.725259:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.725283:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.725302:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789778433.725321:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae637ce/0x5a1e1c1157442417 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789778433.725449:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:994018b1-ce46-430d-a31b-a5e08e23dff3+7:2374:x1876718296102400:12345-192.168.201.45@tcp:4:dd.0 Request processed in 95724us (567601us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789778433.725460:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.45@tcp, seq: 7 00000001:00080000:0.0:1789778433.725843:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1789778434.225210:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789778434.995670:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789778434.995693:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314955008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789778434.995760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778434.996099:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314955008 00000100:00100000:1.0:1789778434.996108:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314955008 00000100:00100000:1.0:1789778434.996177:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789778434.996186:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e98615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314955008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789778434.996220:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789778434.996263:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e98615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876718314955008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778434.996270:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789778434.996306:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876718314955008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789778435.000099:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789778435.249397:0:16030:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789778435.495298:0:16678:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1789778435.505331:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778435.505356:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3d822f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314955136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789778435.505429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778435.509637:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314955520:0@lo:400:kworker.0 00000100:00100000:0.0:1789778435.509704:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789778435.509740:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789778435.509747:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314955648:0@lo:400:kworker.0 00000100:00100000:0.0:1789778435.509770:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778435.510580:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3310:1876718314955264:0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.510621:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778435.510658:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314955776:0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.510686:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778435.510714:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789778435.510720:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b3eb581d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314955392:0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.510754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789778435.510786:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314955520 00000100:00100000:1.0:1789778435.510794:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314955520 00000100:00100000:1.0:1789778435.510833:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314955648 00000100:00100000:1.0:1789778435.510836:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314955648 00000100:00100000:1.0:1789778435.510856:0:16026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314955776 00000100:00100000:1.0:1789778435.510859:0:16026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314955776 00000100:00100000:1.0:1789778435.510875:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789778435.510882:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314955520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.510936:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876718314955520:12345-0@lo:400:kworker.0 Request processed in 53us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778435.510943:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789778435.510961:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789778435.510967:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314955648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.510992:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876718314955648:12345-0@lo:400:kworker.0 Request processed in 26us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778435.510998:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789778435.511015:0:16026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789778435.511021:0:16026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314955776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.511051:0:16026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876718314955776:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789778435.511058:0:16026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789778435.511319:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789778435.511710:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876718314955648:0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.511723:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876718314955520:0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.511759:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876718314955776:0@lo:400:kworker.0 00000100:00100000:0.0:1789778435.512098:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314955264 00000100:00100000:0.0:1789778435.512104:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314955264 00000100:00100000:0.0:1789778435.512145:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789778435.512153:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3ea0125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3310:x1876718314955264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789778435.512213:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3ea0125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d019c5f-5be2-4a6f-8e9a-7a584eb56713+19:3310:x1876718314955264:12345-0@lo:400:kworker.0 Request processed in 61us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789778435.512220:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789778435.512390:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314955392 00000100:00100000:3.0:1789778435.512396:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314955392 00000100:00100000:3.0:1789778435.512429:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789778435.512437:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3e909c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314955392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789778435.512471:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3e909c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876718314955392:12345-0@lo:400:kworker.0 Request processed in 36us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789778435.512487:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789778435.515504:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876718314955392:0@lo:400:kworker.0 00000100:00100000:1.0:1789778435.515520:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3eb581fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d019c5f-5be2-4a6f-8e9a-7a584eb56713:3310:1876718314955264:0@lo:400:kworker.0 00000100:00100000:2.0:1789778435.515869:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876718314955136 00000100:00100000:2.0:1789778435.515877:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876718314955136 00000100:00100000:2.0:1789778435.515942:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789778435.515953:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3eb581df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314955136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789778435.516001:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789778435.516112:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3eb581df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876718314955136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (10683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789778435.516119:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789778435.516125:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789778435.516752:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789778435.516759:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3ec17a9880, transno 8589934595 00000004:00080000:1.0:1789778435.516776:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789778435.516802:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b3d822f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876718314955136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789778436.273726:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29349 lines, 29349 kept, 0 dropped, 0 bad.